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This document comprises the final report of the 
Regional Exchange project, through which Research for Better Schools 
(RBS) has provided research-based information, technical assistance, 
and training services to tae states o2 Delaware, Maryland, New 
Jersey, and Pennsylvania, to assist state educational leaders in 
developing and implementing policies and programs aimed at improving 
local education agencies and their staffs. The first part of the 
report provides a brief review of RBS's history of working with state 
educational leaders, highlighting its goals and some of the ways it 
has conducted its activities. The second part describes eight case 
studies selected to reflect educational improvement priorities to 
which RBS has contributed over the past three years. These 
descriptions illustrate how state educational improvement priorities 
came into being; how a laboratory f:an contribute to the design, 
development, implementation, and institutionalization of programs 
that address those priorities; and what the catcomes of such 
coll«iboration can be for state and local educational agencies. The 
third part summarizes some of the understandings thit RBS has 
developed about states, about RBS itself, and about the conditions 
that allow laboratories to contribute constructively to state 
educational improvement priorities. The last part presents several 
recommendations based on these understandings. Two appendixes are 
included: (1) a five-part summary of the information provided in the 
1983 and 1984 annual reports and the 1935 quarterly reports; and (2) 
a summary of the RBS pilot project to help local education agencies 
assess current practice in light of educational rer.earch and 
development. (TE) 
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EXECUTIVE SUMMARY 



In 1976, NIE funded a set of projects, known as the R&D Exchange, which 
would enable the regional educational laboratories to work collaboratively 
with state education agencies to foster the exchange of Information between 
the educational R&D community and educational practitioners. Since then, RBS 
has provided R&D-based Information, technical assistance, and training 
services to the states of Delaware, Maryland, New Jersey, and Pennsylvania. 

RBS, through Its Regional Exchange project, has pursued one primary goal: 
to support state planning and Implementation of educational Improvement 
programs. From RBS* perspective. Its four states have focused their recent 
educational Improvement programs on four broad goals. 

• Improve students* basic ckllls achievement . All states have been 
helping local districts and schools to Improve students* baric skills 
performance by: (1) clarifying objectives and Identifying effective 
Instructional practices In the basic skills; (2) Instituting testing 
programs to assess students* skills at selected grade levels, and. In 
two states, requiring adequate performance as a prerequisite for high 
school graduation; and (3) developing programs to help districts 
Improve the use of state and federal resources targeted to heir ng 
special needs students acquire the basic skills. 

• Improve curriculum. Instruction, and the use of educational technology . 
The states have: (1) Increased graduation requirements In science, 
mathematics, and other subjects; (2) revised standards and developed 
K-12 guidelines lor many of the basic content areas; (3) provided 
training and support for the Improvcsment of contcnt-tipeclf Ic Instruc- 
tion through sponsoring academies and similar Initiatives; (4) 
Initiated projects to Infuse higher order thinking skills In fhe 
curriculum; and (5) Initiated projects which help schools apply 
microcomputer technology la selected content areas. 

• Improve the quality of teaching s All states have Initiated activities 
aimed at improving the quality of teaching. They are beginning to: 
(1) provide incentives which both encourage good teachers to etay in 
the profession and attract high quality college students to enter the 
profession; (2) develop standards and procedures directed at improving 
the quality of new teachers; and (3) establish programs aimed at 
improving the performance of current teachers and facilitating the 
termination of ineffective teachers • 
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• Improve the effectiveness of schools at all levels . All states have 
considered the results of studies which have sought to identify those 
characteristics which differentiated high end low performing schools, 
and initiated a number of activities aimed at helping local educators 
apply that knowledge. 

RBS has come to see state educational improvement activities as falling 
into three broad types. First, state governments have been establishing new 
expectations regarding student learning outcomes and local educational 
practices. These expectations have been embodied in law, state boaro of 
education mandates, departmental guidelines, state tests, and various kinds 
of state recognition programs; they have also been articulated by governors, 
chief state school officers, state board members, and other state leaders. 

Second, state governments have undertaken a variety of activities to 
encourage local districts, schools, and staff to fulfill the intent of a new 
expectation: (1) prepared and disseminated information about the ii?w 
expectations and how to meet them, (2) provided indepth staff development 
programs, (3) provided personalized technical assistance, (4) provided fiscal 
incentives, (5) provided support for local development/demonstration projects, 
(6> monitored local practices, and (7) threatened sanctions for low or non- 
performance . 

Third, state governments have provided general services which are 
supportive of local school improvement: provided information services which 
facilitate the exchange of knowledge and expertise, sponsored regular 
conferences and meetings to facilitate exchange of information and encourage 
the exploration of Issues, and built and maintained networks of persons and 
agencies which share common educational improvement Interests and concerns. 

Over the past three years, RBS has supported 21 state educational 
improvement programs and projects — for example; 
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• Maryland's program to encourage schools to Implement R&D-based instruc- 
tional processes 

• Delaware's project to Increase school's use of computers as an instruc- 
tional resource 

• Maryland's program to Improve teacher quality 

• Pennsylvania's program to improve the quality of local teacher super- 
vision/evaluation systems 

• Delaware's project to improve the education provided delinquent and 
disruptive youth 

• New Jersey ^8 program to Improve the q::al:'''v of education provided by 
its urban schools 

In addition, RBS contributed to a small number of multi-state improvement 
efforts — for erample, the six-state cooperative project .o develop and 
Implement a process which would Improve the effectiveness of local Chapter 1 
programs. 

In supporting state educational improvement activities, RBS has provided 
five types of services. 

• Information services * RBS staff have collected information pertinent 
to a 3pecific state leader's task, summarized that information in a 
form appropriate for that task, and presented the summary in person to 
the state leader. 

• Planning assistance . RBS staff have helped state leaders design 
comprehensive school improvement programs as well as more limited 
state educational improvement initiatives. 

• Implementation-related sewices . RBS staff have helped state staff 
with the design and conduct of orientation anU staff development 
programs aimed at helping local educational leaders implement new 
practices. RBS has also helped state staff with the development of 
specific resource materials which will support local implementation. 
Finally, RBS hd<q he lped state staff design and provide technical 
assistance in support of local implementation. 

• Evaluation/research services . RBS staff have designed and conducted 
studies aimed at providing information which will help state leaders 
plan, implement, and refine state educational improvement programs. 

Convening services . RBS has brought together state staff from across 
the region to consider research-related topics, developing educational 
issues, and the effects of current state educational improvement 
efforts. 

6 
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In providing these services, KBS has sought to achieve three knowledge 
utilization outcomes. Firsts RBS has tried to Increase state leaders' aware- 
ness and understanding of educational R&D which may have implications for the 
design and Implementation tasks in which they are engaged. Second^ assuming 
success In achieving the first outcome, RBS has tried to help state leaders 
modify or develop policies, guidelines, programs, and resource documents, so 
that they reflect current R&D findings. Finally » assuming some success with 
the second outcome » RBS has tried to help state le«.ders modify such state 
practices as the assistance they offer schools and districts » the staff devel- 
opment programs they conduct » and the way uhey monitor school and district 
performance. From RBS* perspective » the states have sought an analogous set 
of outcomes r They have sought to Increase school and district staff awareness 
and understanding of what is known » for example » about effective teaching, 
effective classrooms, and effective schools. They have encouraged schools 
and districts to modify or develop policies and plans based on those under- 
standings. And» finally^ they have encouraged schools and districts to modify 
current practices in ways which reflect what is known. 

From its eight-year experience providing services in support of state 
educational Improvement programs » RBS sees four sets of conditions which can 
affect the kinds of outcomes achieved and the scope of Impact of particular 
Improvement programs. Firsts there are such conditions as the following which 
exist within the state. 

• Extent to which state leaders make educational improvement a priority 
of their administration. 

• Extent to which state leaders are able to create the management 
conditions for an effective improvement effort. 

• Extent to which there is stable state leadership. 

• Extent to which state educational improvement efforts establish clear 
and defensible standards or expectations for local educators. 
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• Extent to which state educational Improvement efforts use multiple 
strategies for encouraging local action to meet expectations. 

• Extent to which states design their educational improvement efforts as 
c o llabora t Ives . 

• Extent tc which states are open to outsldp knowledge and resources. 
Second, there Is the condition of the R&D knowledge base, the extent to 

which there Is a knowledge base which speaks to a given state educational 
improvement effort. Third » there are conditions within the laboratory; these 
are primarily related to the extent to which appropriate staff* in terms of 
knowledge and skill, can be assigned at the time and at a level of effort 
which will be responsive to state interests and needs. Fourth, there are 
conditions external to the state-laboratory relationship, such as national 
priorities, externally available discretionary funds, and information 
suggesting a new, critical need. 

RBS* experience in supporting state educational Improvement activities 
has implications for federal and laboratory leadership. It suggests the 
following recommendations for federal leadership. 

• Use a greater variety of strategies to encourage laboratories to meet 
the expectations which have been established for their state leader- 
ship assistance projects. 

• Provide leadership and incentive funds for multi-state collaborative 
improvement projects. 

It also suggests the following recommendations for laboratory leadership. 

• Use the knowledge and perspectives presented in this report in 
negotiations with state leaders. 

• Continue to support documentation and assessment activities which 
expand understanding of how states can best affect the quality of 
local educational practice, and how laboratories can best assist them. 
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INTRODUCTION 



This final report Is Intended for persons who are Interested In how 
]<nhoratorles ran bent assist state educational leaders to develop <ind Imple- 
ment policies and programs aimed at improving the quality and effectiveness of 
local education agencies and their staffs. It is organized into four parts* 
The first provides a brief review of RBS* history of working with state 
educational leaders, highlighting its goals and some of the ways it has 
conducted its activities. The second describes, in some detail, eight educa- 
tional improvement priorities to which RBS has contributed over the past three 
years. These descriptions illustrate how state educational improvement 
priorities come into being; how a laboratory can contribute to the design, 
development, implementation, and, in somu cases, institutionalization of 
programs which address those priorities; and what the outcomes of such collab- 
oration can be for state and local education agencies. The third summarizes 
some of the understandings which RBS has developed about states, itself, and 
the conditions which allow laboratories to contribute constructively to state 
educatx nal improvement priorities. The last presents several recommendations 
based on these understandings. 

The report has two appendices. The first summarizes, the information 
provided in the 1983 and 198A Annual Reports, and the 1985 Quarterly Reports. 
It is organized into five sections. The first four summarize RBS* work with 
Delaware, Maryland, New Jersey, and Pennsylvania, respectively. The fifth 
describes multi-state and regional activities whicn RBS has undertaken. 

The second appendix summarizes RBS* pilot project to help locax education 
agencies assess aspects of current practice in the light of educational R&D, 
and develop Improvement plans based on that assessment. 
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THE RBS EXCHANGE PROJECT 

ThlF -section begins with a brief historical review of RBS* relationship 
with state educational agencies. It then describee the basic characteristics 
of the RBS Exchange Project ovrr the past rhree years: its goals» its general 
approach and procedures^ and its organization aiw. management of staff. 

Historical Review 

In 1966 » the ^irst year of its existence » RBS initiated a modest project 
(3 PTE) aimed at helping educational leaders use the results of current 
research. That project included state educational leaders as part of its 
client group. After two years of e:ploration» RBS decided to discontinue the 
project for a aumber of reasons. ThasA Inrluded: (I) state leaders were 
defining their role and responsibilities as primarily regulatory, (2) the 
existing knowledge base did not speak to the tasks and problems of the proj- 
ect's clients » (3) RBS was unable to access the knowledge base efficiently 
(ERIC was Just being initiated), and (4) RBS staff had limited experience in 
playing the role of disseminator. 

In 1975 and 1976, through an NIE-funded project which enabled the labora- 
tory to explore ways it could relate to state education agencies, intermediate 
units, study councils, and educational associations, RBS determl'aed that it 
ccaid affect the quality and impact of selected school improvement efforts 
under certain conditions. The notable project activities were: (1) the 
development of materials and the implementation of a series of workshops, in 
collaboration with the New Jersey School Boards Associatic^, to help school 
boards and superintendents understand their role and responsibilities under 
the new Thorough and Efficient legislation; (2) the development of a desegre* 
gation plan for New Castle County, Delaware; and (3) the design of a project 
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to improve the basic skills performance of selected schools, which was led by 
che Pennsylvania Department of Education and in^'olved two Intermediate units, 
the Learning Research and Development Center at the University of Pittsburgh, 
and RBS. 

In 1976, as this exploratory project was ending, NIE requested labora- 
tories to develop plans for projects which would have them work collabora* 
tlvely with state education agencies to foster the exchange of information 
between the educational R&D community and educational practitioners. That is, 
to foster the communication of Information about the work of researchers and 
developern to practitioners; and the communication of Information about 
practitioner needs to researchers, developers, and R&D policymakers. The 
entire set of projects was to be known as the R&D Exchange. 

In response, RBS and the states of Delaware, Maryland, and Pennsylvania 
developed a plan for a Mld-Atlantlc Regional Exchange. In March 1977, the RBS 
Regional Exchange began providing R&D-based Information, technical assistance, 
anr training services to those three states. In the spring of 1979, those 
services were extended to the state oi New Jersey. Also In 1979, the Exchange 
bec£me a major component of RBS* research, development, and dissemination 
program, supported by NIE under Its then-existing "special institutional 
relationship** policy. Each year since 1979, RBS* management has met with 
state leaders to review the work of the Exchange and to consider whether the 
project should be continued. The decision has been tc proceed, because each 
year the assessment has determined that: 

• the states of Delaware, Maryland, New Jersey, and Pennsylvania were 
considering, designing, and/or iimlementlng programs aimed at influ- 
encing the quality local e-iuci.' lonal practices 

• RBS* services i through the Exchange project, did help state staff use 
current educational R&D-based knowledge as they considered, designed, 
and/or implemented selected educatlDii&l improvement programs 



• some of the resulting programs have established now expectations for 
local educational practice, and encouraged some schools and districts 
to make the Improvements necessary to meet those expectations. 

G oals of the RBS Exchange 

Over the past three years, the l3S Exchange has continued to pursue one 
primary goal: to support state planning and Implementation of educational 
Improvement programs by providing R&D«-based Information, technical assistance, 
and training. This goal recognizes the leadership position which the states 
In Its region have assumed toward educational improvement. 

In supporting state-led educational Improvement efforts, the RBS Exchange 
has also sought to contribute to the three goals which NIE first posted for 
whe R&D Exchange. First, It has sought to Increase the use of R&D outcomes by 
educators developing and /or benefiting from state educational Improvement 
efforts. Second, It has sought to encourage increased coordination among 
dissemination and educational Improvement efforts across levels within each 
state and across its region. And third, it has sought to gather information 
about the experience of state educational improvement efforts which would help 
the laboratory plan future research and development efforts. 

These three goals have provided structure to the Exchangers primary pur- 
pose of supporting state planning and implementation of educational improvement 
efforts. Specifically, the first hat? emphasized that the principal support 
provided by the Exchange would be R&D-based. The second has emphasized that in 
its wcrk with the states, the Exchange would facilitate communication and 
foster exchange of ideas and resources among units within a state education 
ardency, across education levels within a state, and among state agencies in a 
region. The third has emphasized that in its work with the states the Exchange 
would seek to gain experience and information which would be of value to those 
planning future R^D programs. 
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General Dissemination Approach 
To achieve Its objective of providing support to state planning and 
implemertatlon of educational Improvement efforts, RBS staff adopted a client- 
centered, cllent-responslve, dissemination approach Involving four general 
processes (which do not necessarily occur In a linear fashion): needs 
Identification and clarification, knowledge building, Information prepara- 
tion/transformation, and Information delivery and assistance. Each of these 
four processes Is described more fully below. 

Naeds Identification and Clarification 

The purpose of needs Identification and clarification has been to 
determine which state educational improvement p iorltles would be supported by 
Exchange activity, and how that support would be provided. It has been 
conducted as a negotlative process at several levels. 

At the highest level, RBS has often negotiated priorities with a liaison 
person designated by the chief state school officer. The state liaison person 
has usually been a senior official with an overview of the state's program 
priorities and, in some cases, has had management responsibility for some of 
the state's principal educational Improvement programs. The discussions with 
state liaison persons have occurred several times a year, to review current 
state priorities and related Exchange activities. Existing state p-lorities 
have either been confirmed, or new priorities have been set for the Exchange. 

Within the framevork established with the state liaison person, RBS 
staff have then proceeded to negotiate their specific roles with state staff 
responsible for particular priorities. Through these negotlitlons, RBS staff 
have clarified the tasks associated with each priority, the schedule of work, 
and the roles of other participants. In aldltlon, they have determined the 
kinds of knowledge which might be helpful. Sometimes, as part of this 
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process, RBS staff have collected Information from local practitioners to help 
the state and RBS determine ^he state-of-the-art practice and site-specific 
needs for the state activity. 

Knowledge Building 

The process of knowledge building has been Interwoven with the process 
ol needs clarification. RBS staff have engaged In two kinds of knowledge 
building: anticipatory and responsive. In both cases, the process has 
Involved three activities: Identification of useful sources of Information, 
search and retrieval of Information, and screening and organization of the 
Information most relevant to the task at hand. These three activities have 
been facilitated by the RBS Resource Center, by other members of the R&D 
Exchaitge, at^d by Informal networks within RBS F.nd across the country. That 
Is, RBS staff have been assisted by Resource Center staff in conducting 
computer searches of ERIC and similar data bases, accessing materials from 
nearby public and university libraries, and classifying and filing the 
accessed materials. RBS staff have been assisted by other members o^ the 
R&D Exchange, both through the formal system of central support services and 
through more Informal systems of exchange. For example, the Resource Referral 
Service at Ohio State University has been tapped to Identify agencies and 
Individuals working on questions related to state tasks. Finally, RBS staff 
have developed Informal networks with Individuals at universities and colleges; 
at federal, state, and local education agencies; and at Information services 
and teacher centers. Information gathering from these sources has been 
Initiated either In person or by telephone— whichever Is the fastest mcchod 
for Identifying Information most relevant to a given task. 
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All three activities have been used to Identify and retrieve Information 
for both anticipatory and directly responsive knowledge building. When trends 
are strongs files have been built In anticipation of state needs; when change 
has occurred quickly » information has been accessed In direct response to 
specific needs. The former has allowed for comprehensive file building, 
the latter— usually with tight time constraints — has required accurate 
clarification of needs » and focused on obtaining Immediately relevant 
materials. 

Information Preparation/Transformation 

Information acquired by RBS staff has rarely been delivered to state 
clients In Its original form. Responding to the specific needs of a client 
group has required selection and collation of Information from several 
sources; preparation of a synthesis of the Information; translation of the 
Information Into a more readily understandable language; adaptation of infor- 
mation into another form (e.g.» a research report Into workshop materials); or 
a specific analysis of the Information and Its value to a certain task. RBS 
staff have carried out such transformations, tailoring particular information 
to the specific needs of client groups. 

RBS* Information products have taken such forms as matrices, flow charts, 
diagrams, tables, collections of key citations ("highlights") accompanied by 
short bibliographies, annotated bibliographies, and research papers. RBS 
staff have also developed workshop materials which Include discussion papers, 
worksheets, simulations i guidelines, overhead transparencies, and audio and 
video tapes. It has also compiled collections of carefully selected samples 
of materials on specific topics. 
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Infonnatlon Delivery and Assistance 



In order to Increase the probability that the Infonnatlon provided would 
be used, RBS staff have delivered the Infonnatlon In person, and offered to 
provide assistance In Its use* In general, RBS* assistance has taken the 
following three forms, depending on the nature of the task, the structure and 
organization of the client group, and the content of the Information* 

• Per&onallzed technical assistance * staff have helped state 
leaders consider Information which could help them with a specific 
task* 

• Planning and design assistance . RBS staff have worked as members of 
state planning groups. In that capacity, they have both contributed 
Information and Ideas based on the Information collected, and 
undertaken specific planning tasks* 

• Implementation assistance * RBS staff have helped with the develop- 
ment specific resource materials needed to support the Implementation 
process (e*g , planning guides, descriptions of recomitended practices, 
syntheses of research, lists of resources, developed Instruments). 
RBS staff have also helped with the design and conduct of orientation 
and staff development programs for state and/or local staff* Finally, 
RBS staff have provided evaluation services in a manner consistent 
with an "action research" model. That is, RBS staff have collected 
information from school district staff with whom the state staff has 
been working, summarized that information in a form useful to the 
state staff involved, and presented state 'staff with that information 
and other related research in a manner and at a time which enables 
state staff to take steps to improve their educational Improvement 
efforts. 

In summary, through the looping processes of needs identification and 
clarification, knowledge building. Information preparation and transformation, 
and information delivery and assistance, RBS staff have sought to support 
the planning and in^lementation of statewide programs aimed at stimulating 
' nd supporting local educational improvement. 



Other Complementary Approaches 

In addition to the client responsive approach, the Exchange has also 
initiated activities of Its own with the states* For example, in cooperation 
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with NIE, the R&D Interpretation Service (RDIS), and other NIE contractors, 
RBS brought to the attention of key state staff many major research reports 
and knowledge syntheses. It has also aggressively pursued opportunities to 
present the contents of those reports and syntheses to state staffs In a 
task-relevant way. Further, RBS has periodically Initiated collaborative 
planning and conducted one and two-dav conferences at which state staff could 
share their current program activities and consider the Implications of recent 
research for those activities. Finally, RBS has stimulated and contributed to 
multi-state projects. In all of these activities, RBS has played a proactive 
role In stimulating state use of current knowledge to facilitate Intra-state 
and multi-state collaboration and sharing. 

Organization and Management 

To Implement these approaches, the RBS Regional Exchange director estab- 
lished four state teams and, as required, designated individual project staff 
to assume leadership of specific multi-state ^^nd regional activities. 

Each team has been responsible for Identifying a state's needs and 
priorities, and for negotiating with state leadere the specific contributions 
that RBS would make to selected priorities. The team has usually assumed 
responsibility for delivering the requested services. However, when a priori- 
ty has required knowledge and skills of persons outside of the team, these 
resources have been negotiated with other teams or been obtained frra other 
laboratory projects. 

Each state team has had a full-time staff member. Three teams have also 
had a managemi^nt team member assigned to them on a part-time basis. Over the 
past three years, these teams have drawn on the services of 12 other RBS 
staff. 
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Though a team has been established for each state, the level of services 
actually provided each state has depended on a complex of conditions. For 
example, the clarity of state needs, the extent to which a state has organized 
its staff and resources to meet those needs, a state's openness to outside 
assistance^ the availability of RBS* resources^ and the knowledge and 
interests of RBS staff have all played a part in this determination. On the 
average^ states have received between .09 and 1.3 FTE of service a year, 
though RBS' services to individual states may range between .06 and 2 FTE 
within a given year. 

Multi-state and regional activities have occurred as a result of the 
availability of an outside resource (e.g., a Research Within Reach publica- 
tion), an outside initiative (e.g., the Secretary of Education's Chapter 1 
program Improvement initiative), or a shared need or interest across states 
(e.g., concern about what happens to graduates of high cost special education 
programs). Depending on the scope of a multi-state or regional activity, 
either an individual staff member or a small ad hoc staff team has plannned 
and carried out the activity. 

The organization and staffing of the RBS Exchange project over the past 
three years is summarized In Figure 1. 
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Figure 1 

Organization and Staffing of the Exchange Project 
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MAJOR ACTIVITIES AND THEIR OUTCOMES 



During the past three years, RBS has contributed to 21 state priorities 
and undertake" 10 multi-state or regional activities. These priorities and 
activities, RBS* contributions to them, and their outcomes are summarized In 
Appendix A. This section provides a narrative description of eight of these 
Improvement efforts. The eight cases have been selected to reflect the 
variety of state educational Improvement activities on which RBS has worked, 
the range of services RBS has provided In support of these activities, the 
kinds of outcomes which can be achieved through such activities, and some of 
the conditions which Influenced the scope and impact of these efforts. 



Six of the eight cases describe educational Improvement activities of 
the states with which RBS works. Their goals were to: 

• encourage schools to implement more effective R&D-*based instruc- 
tional processes 

• increase school's use of computers as in instructional resource 
^ improve teacher quality 

• improve the quality of local teacher supervision/evaluation systems 

• improve educational programs for delinquent and disruptive youth 

• improve the quality of education provided by urban schools. 

The remaining two cases represent major multi-state and regional activities. 
The first was a six-state project to develop and implement a process tc 
improve the effectiveness o2 local Chapter 1 programs* The second was a 
collaborative effort of the R&D Exchange to increase educators* awareness and 
understanding of research related to teaching the basic skills and science. 

As the eight cases reveal, each had a different origin (see Figure 2). 
One was initiated by the U.S. Secretary of Education, but was defined by a 
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Figure 2 

SOURCE OF THE INITIATIVES 
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collaborative planning group made up of six state Chapter 1 directors and 
three technical assletance agencies, Including RBS* Two were presented as 
part of governors* educational reform agenda vMch were developed with the 
support of their chief state school officer. Three were basically initiated 
by state education agency leadership. One developed as a result of a decision 
by the R&D Exchange project directors; RBS* Exchange director participated ii 
that decision. And one grew out of needs sensing activities which RBS under- 
took, and for which RBS gained support of state education agency leaders. 

Though their goals and origins differed, all eight improvement activities 
had three interrelated purposes. The first was to e8tabli«^h or strengthen 
state policies and services which would support local improvements. The 
second was to affect local educational policy and practice in specific ways. 
The third expressed the ultimate intent — to affect student attendance, behav- 
ior, and/or achievement. Figure 3 suggests some of the specific ways in which 
these purposes were focused, it indicates that the eight activities varied in 
number and kinds of state services which they intended to establish or 
strengthen, in the kinds of local improvement which they intended to affect, 
and in the extent to which those Improvement were explicitly linked to some 
kind of student outcome. Each of the case descriptions which follow begins 
with a brief overview. Each then describes the major phases through which the 
improvement activity moved. The descriptions highlight both state and RBS 
activities. Each concludes wiLh a susmary of outcomes. At the end of the 
report, there is a listing of the major products, by case study, which RBS 
developed and /or contributed to. 
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1. Encourage Schools to Implement More Effective 
R&D-based Instructional Processes 

The School Improvement Through Instructional Process (SITIP) program was 
Initiated In 1980 by the Maryland State Department of Education (MSDE), and 
resulted In all 24 county school systems putting Into practice research on 
effective classrooms and planned change. By June 1985, over 22 percent of 
Maryland's schools were Involved (about 3,800 teachers In 270 schools), with 
almost equal representation of elementary and secondary schools. 

This case traces the development. Implementation, and expansion of the 
SITIP program, and of RfiS* role In It. 

Early Planning 

The need for a state program aimed at improving instruction in classrooms 
was identified by MSDE staff responsible for the statewide corapetency-based 
program. Their analysis of test scores and classroom observations suggested 
that districts implementing the program needed to address instructional 
processes as well as the curriculum. In mid-1980, MSDE therefore decided to 
initiate a program to help Maryland's districts, schools, and teachers use 
research-based instructional practices. With the assistance of RBS, MSDE 
identified four instruction models which would be the focus of the program: 
Active Teaching (AT), based on the work of Thomas Good at the University of 
Missouri; Mastery Learning (ML), based on the work of Benjamin Bloom and his 
colleagues at the University of Chicago; Student Team Learning (STL), devel- 
oped at the John Hopkins University's Center for the Study of School Organiza- 
tion; and Teaching Variables (TV), a preliminary version of RBS' Achievement 
Directed Leadership program. 

The Implementation plan for the program was influenced by the success of 
two other MSDE programs; (1) the Professional Development Academy, which 
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provided Intensive training and follov-up to prlnclpa.8, and (2) Project 
Basic, the staters competency program, which employed an Implementation 
strategy based on current research on planned change. Later, national 
attention to the research on school and classroom effectiveness and the 
various reports on educational Issues, such as "A Nation at Risk," provided 
an additional positive press for local Implementation of SITIP. 

As the program got underway In 1981, three decisions were made which had 
major impact on the program. First, MSDE assigned the leadership of SITIP to 
their Assistant Deputy Superintendent, who was also the director of Project 
Basic, the chairperson of the MSDE Instructional Coordinating Council, and the 
RBS liaison. This assignment ensured effective communication and coordination 
among the staff involved. Second, RBS reassigned staff, moving accountability 
for SITIP from evaluation j technical assistance staff. This decision 
changed the focus of RBS^ efforts, resulting in Increased involvement in SITIP 
planning, and in the provision of information on classroom and school effec- 
tiveness and on planned change. And third, as it became clear that the 
support which MSDE wanted from RBS would exceed its available resources, MSDE 
decided to enter into a cost-sharing arrangement with RBS. That arrangement 
increased the number of RBS staff involved in the program and the impact of 
RBS* effort.* 

The plan for the initial phase of the program had four components. 
First, there would be a series of four awareness conferences — one for each of 



♦Throughout the project, the RBS state coordinator for Mary lard, a member 
of the Regional Exchange, provided overall leadership, directed the study, 
conducted training, and developed research syntheses. In addition, the staff 
of the Basic Skills Component conducted training on Teaching Variables; staff 
of the Research and Evaluation Division assisted with the study; and other 
staff of the Regional Exchange assisted In providing information, training, 
and technical assistance. 
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the Instructional models— to which all school districts would be Invited. 
Second » small grants (up to $10»000) would be mad* available to districts 
Interested In implementing one or more models. To receive a grant, districts 
had only to prepare a short proposal which described the model (s) they had 
selected, their l]q>lementatlon strategy^ and their proposed use of grant 
funds. Third » Intensive training would be provided -o school Implementation 
teams during the summer. Four^h» annual Instructional leadership conferences 
would be sponsored by MSDE for state and local educators. Each conference 
vould Include presentations by local teams Involved In SITIP and by research- 
c 3 such as Jane Stalllng£» Karen Louis » Barak Rosenshlne» and Bruce Joyce. 
fix h» RBS would collect evaluation data related to each of the program* s 
acti ties and report It In a way which would help MSDE and district staff 
make ac^ otments. As a result of recommendations made by RBS» the plan was 
modified In the summer of 1981 to provide In-person technical assistance to 
districts and schools from a team of MSDE staff drawn from five Instructional 
divisions. 

Implementatio n 

Tullowlag the conferences which featured the developers of the four 
Instructional models^ 19 of the 24 districts submitted preliminary proposals 
for implementation and subsequently received small grants from MSDE. During 
the summer » the developers provided Intensive training to Implementation teams 
from the districts. Districts were asked by MSDE to revise their plans based 
on the trainings and to then proceed to Implement those plans. In support of 
these actlvltle8f» MSDE technical assistance staff rrovlded on-site coaching, 
helped local teams conduct staff development workshops, and provided trouble- 
shooting assistance to overcome Implementation problems. They also conducted 
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one or two workshops each year at which districts implementing the same model 
could share accomplishments, consider evaluation data provided by RBS, explore 
alternative approaches to implementation problems, and receive additional 
training. In the spring of 1982, MSDE sponsored a state conference which 
provided opportunity for the districts to showcase their projects and to hear 
presentations by national experts on instmctional improvement and planned 
change* 

For the next three years, as the local instructional Improvement efforts 
moved through the various phases of implementation and institutionalization, 
MSDE provided continuing technical assistance and sponsored state conferences 
each spring. 

Throughout this period, RBS carried out four major supporting activities. 
First, RBS evaluated all major conferences and training events, and rrepared 
reports which provided information for future MSDE planning and technical 
assistance. Second, RBS evaluated the overall program at the state and local 
levels to determine progress on a variety of goals and summarized the findings 
in four annual reports. Goals evaluated by RBS included MSDE's goals to 
incr3ase internal coordination, to increase purposeful communication between 
MSDE and the 24 districts, and to encourage significant instructional improve- 
ment at school and classroom levels; they also included the districts* goals 
to promote teachers* professional growth and instructional effectiveness. 
Third, RBS provided ongoing planning assistance to MSLE technical assistance 
teams. Fourth, RBS developed materials and conducted training, ba{:ed on the 
research on classroom effectiveness and planned change. Specifically, through 
training, information exchange, and feedback of evaluation findings, RBS 
facilitated MSDE staff's use of procedures to improve state and district 
communication, facilitate croaa-hierarchical decision-snaking, establish 
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district networks, conduct high-Impact staff development activities, and 
maintain harmony and productivity In the local projects, and between state and 
local groups. 

As a result of RBS' efforts, MSDE and district staff gained Increased 
Insight Into the process of school Improvement. For example, RBS determined 
that the districts used the four following Implementation strategies, and 
that tnese strategies had a major Influence on what specific districts 
accomplished. 

• Distrlct-wlde . All schools at a given level (usually elementary) were 
Involved. A selected model was used routinely by all teachers In a 
specific subject. This strategy required the most work from the most 
people, with central office staff enthusiasm and support most Impor- 
tant for Its success. Two districts began with this strategy. By 
June 1985, three were Implementing It. All three implemented Active 
Teaching. The largest project Involved 33 schools. 

• Pllot/dlstrict t One to three schools were Involved In the first year, 
with strong central office support for school-based activities. 
Evidence of success led to greater administrative Involvement and. In 
some cases, use of selected teachers as turnkey trainers « This 
strategy was the most feasible, especially for complex models. Five 
districts began with this strategy, and eight were usJng It by June 
1985. The largest number of schools Involved In a pllot/dlstrlct LEA 
was 56. 

• Capacity building . The LEA team that participated In the MSDE Insti- 
tutes trained volunteer teachers who were willing to "try" the model. 
There was no formal commitment to follow-up by admlulstrators. Where 
this strategy was effective, an administrator did "energize" the 
project. Five districts, all using Student Team Learning, began with 
this strategy; the efforts of three waned during the second or third 
year. By June 1985, there were four capacity building districts, with 
25 schools Involved In the largest project. 

• Lighthouse . A single school was Involved, and no commitment was made 
by central office staff to advocate further use or to Initiate plan- 
ning or training for other schools. Success was usually shared 
Informally with other schools. This strategy put the greatest burden 
on the pilot school staff. There were 20 lighthouse sites Initially. 
By June 1985, there were 13 lighthouse sites. In the districts using 
this strategy, the largest number of schools Involved was 7 (each of 
the four Instructional models was employed In one or more of the 
lighthouse schools). 
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RBS* studtes also sugget^ted that district deslgnF or plans for Insr.ruct tonal 
Improvenient were most ll'cely to be successful If: (1) participation of 
organizations was voluntary and cross-hierarchical, (2) communication was 
multl-dlmenslonal, (3) planning was Interactive with training, (3) training 
and technical assistance were provided during Implemantatlon, (5) "lip service 
compliance" was not accepted as Implementation, (6) adjustments of scope were 
conslden^d legitimate and related to resources available, and (7) each parti- 
cipant had some degree of choice about his or her involvement In the effort. 

Expansion and Coordination 

During the four school years beginning In September 1981, SITIP expanded 
In the numbers of districts, schools, and teachers involved* In addition, 
MSDE initiated several related programs* For instance, MSDE staff used the 
SITIP design in a program in which MSDE provided training for faculties of 
colleges of education, and MSDE staff drew on the SITIP knowledge base for 
Chapter I and special education initiatives* MSDE conducted retreats for 
state and local policy makers to encourage discussion of Instructional ''r- 
provement and planned change. 

RBS played a part in all of these activities* Its staff developed 
research syntheses, conducted workshops, provided technical assistance, 
provided information, and evaluated specific events. RBS staff also dissem- 
inated information about Maryland's instructional Improvement efforts through 
presentations at national, regional, and local professional meetings* 

Outcomes 

The School Improvement Through Instructional Process program has, over 

Its five years of existence, had a wide variety outcomes* Most notable are: 

• MSDE staff's growth in knowledge and understanding of what a state 
education agency can do to influence instructional improvement 
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• MSDE staff's ability to provide effective training and technical 
assistance to district and school stafl 

• the adoption of Improved Instructional practices In more than 22 
percent of Maryland's schools 

• the evidence that there were Increases In student achievement where 
models were Implemented with fidelity and used consistently 

• the Increased understanding of factors which can contribute to the 
process of school and classroooi Improvement. 

2. In^rrease Schools' Use of Conyuters 
as an Instructional Resource 

v/lth the encouragement and support of RBS and Project Direct (Delaware's 

computer facility) staff, Delaware's Department of Public Instruction (DPi) 

curriculum supervisors Increased their knowledge and understanding of how 

computers can be used In language arts* mathematics, and social studies 

programs, and undertook a collaborative project with the Red Clay Consolidated 

School District to develop lessons In those subjects which Incorporated the 

use of computers as Instructional resources. Currently, the supervisors, with 

continuing assistance from RBS and Project Direct staff, are developing 

resource guides and Inservlce programs which will help teachers throughout the 

state to use computers In their language arts, mathematics, and social studies 

programs. 

This case describes the activities which have occurred over the past 
three years to help DPI supervisors develop the capacity to provide leadership 
In the use of microcomputers lu traditional subject areas. 

Identifying a Need 

In October 1982- RBS Invited representatives from each of Its states to 
attend a one-day meeting at the laboratory. The purpose was to provide an 
opportunity for state leaders to describe the roles they were playVig with 
respect to the use of microcomputer technology and to discuss pending problems 
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and needs. In preparing for the conference, RBS staff reviewed available 
literature related to the topic and the small number of state plans which were 
then avallabl3. As a result of the conference, RBS Identified five areas of 
state activity. One was directed toward helping all students and teachers 
become computer literate; a second was concerned with obtaining access for 
schools to basic skills drill and practice programs like the Con^uter Curric- 
ulum Corporation (CCC) materials; a third was aimed toward exploring the value 
of traditional business application programs (word processing, data base 
management, spreadsheet. Information search and retrieval) in both regular and 
vocational education courses; a fourth sought to explore ways the computer 
could help students achieve traditional school subject objectives; and a fifth 
was Involved with developing hardware configurations which would facilitate 
schools' use of computers. 

RBS decided It could best contribute by working In the fourth area, 
helping to develop ways for teachers to Incorporate the computer as an In- 
structional resource Into their language arts, mathematics, social studies, 
and science programs. During the winter of 1983, RBS staff began to develop 
a knowledge base related to the topic, sponsored two fcllow-up meetings with 
state staff Involved In responding to school staffs' lequests for information 
about computer applications in education, and developed a mock*-up of a re- 
source book for teachers Interested in using computers in their writing 
programs. 

As a result of a number of Informal discussions with state leaders, RBl 
decided to approach the Delaware state staff with the idea of a collaborative 



*Three Exchange staff, supported by the RBS Resource Center, were involved in 
the initial planning of this activity. The Delaware dissemination special'^ 
list was responsible for all the field activities with the curriculum 
supervisors. 
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project* Through the project, DPI would develop Its capacity to provide 
leadership to traditional subject matter teachers regarding the use of 
computers by designing resource guides and Inservlce programs. Delaware 
seemed to be the most appropriate state for such a project because: 

• the state had Invested In a major computer facility. Project Direct, 
to provide basic skills drill and practice exercises over telephone 
lines to all schools In the state 

• its districts had purchased a significant number of microcomputers 

• the state department was conducting a computer literacy Inservlce 
program aimed at reaching every teacher in the state 

• the state had purchased a membership In MECC (Minnesota Educational 
Computer Consortium) which enable school staffs throughout the state 
to receive copies of their programs 

• the state departmr had initiated a planning effort which would 
result in a compre aslve Ion'' -range plan for computers in education 

• the state department's curriculum supervisors regularly offered inser- 
vlce programs to the state's 19 echool districts. 

Exploration and Planning 

In May 1983, RBS staff met with Delaware's Division of Instruction staff 
to explore the project idea. As a result of that meeting, four currlcultm 
supervisors agreed to work with RBS staff, though only one had experience with 
microcomputers. Therefore, it was necessary to address first their need for 
hands-on experience with microcomputers and with software relevant to their 
subject area. Project Direct staff, with the support of RBS staff, conducted 
at their facility several workshops for the supervisors. In subsequent 
planning meetings, the supervisors decided to design resource guides which 
wiuld describe how computers could be used in each subject area, provide 
concrete examples of lessons which incorporated computer software, and provide 
both information about state computer resources and an up-to-date bibliography 
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of books and articles describing computer applications and effective software. 
They also decided that such materials could best be developed In collaboration 
with the staff of a school district. 

One spin-off of this work with the supervisors was the request by one of 
them for RBS to participate on Delaware *s computer planning committee. The 
comr ttee Included staff from DPI and a representative from each of the school 
districts. Its task was to develop a comprehensive plan to guide local activi- 
ties for the next several years. As a member of tie committee, RBS contributed 
to all aspects of the plan; however, It worked Intensively for the Inclusion 
of activities related to the use of the computers In traditional subject areas. 
The existence of the plan encouraged the state legislature to Increase funding 
for technology In 1985. 

Subsequently, DPI asked RBS to prepare a paper which would provide an 
overview of Instructional uses of microcomputers. This paper was presented at 
a state-sponsored workshop In the fall of 1984, which Involved admlninstrators 
from every district In the state. 

Red Clay Consolidated School District Project 

In April 1984, DPI, DIRECT, and RBS staff negotiated a cooperative project 
with Che Red Clay Consolidated School District which had recently purchased a 
significant number of microcomputers for each of Its schools. The project 
Involved three phases. First, three subject matter teams from a high school, 
middle school, and an elementary school were to participate In an Inservlce 
program to be conducted during May and June (1984) by DPI, DIRECT, and RBS 
staff, and to produce a set of lesson plans Incorporating computer software. 
Second, the teachers were to pilot the lesson plans during the 1984-85 school 
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year, allow project staff to observe those lessons, and make any revisions 
suggested by the pilot. Finally, project staff were to use the revised lesson 
plans to develop resource guides and Inservlce programs. 

The first part of the project unfolded as planned. Principals from all 
of Red Clay^s schools were Introduced to the project. Two Inservlce sessions 
in May presented the project to the selected teachers and provided a hands-on 
experience In previewing software and planning a lesson which used that 
software. A week-long Inservlce program In June enaLled each of the teacher 
teams to preview four to eight pieces of software and to develop a number of 
draft lesson plans. As a whole, the group produced over 100 draft planr. The 
week*s program culminated In a session In which teachers and principals 
worked together Co plan how the computers In their buildings could best be 
managed. 

Between September 198A and June 1985, project staff observed teachers 
piloting lessons. Drawing upon their experience to date, project staff 
drafted materials which addressed the identified needs of teachers and prin- 
cipals, and which could be used in future inservlce programs. The materials 
addressed teachers* general reluctance to work with unfamiliar technology, 
their need for strategies to help them approach both the task of previewing 
sof are and the task of developing lesson plans which could be understood by 
others, and their need for examples of how hardware could be configured and 
managed. 

Over the summer of 1985, project staff conducted several one to two-day 
workshops during which the draft materials and lesson plans were tested with 
snail groups of teachers. These teachers provided many suggestions for 
improving the materials. 
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Development of Resource Guides 

Using the results of the Red Clay project and the summer workshops, PPI 
began compiling the resource materials Into coherent resource guides. The 
Initial set of guides are to help teachers of language art^, mathematics, and 
social studies plan and conduct lessons which use computers as an effective 
Instructional resource. The guides will have four major sectl ns: (I) using 
computers to teach the subject, (2) developing Instructional activities, (3) 
selecting educational software, and (4) using other resources. 

RBS has agreed to help the supervisors with this development effort. 
Current plans call for the guides to be completed by February or i. h 1986, 
for use In a ''prlng Inservlce program to be conducted by DPI staff. 



RBS's contributions to the project have: (1) increased DPI staff 
awareness and knowledge of how computers can be used effectively In language 
arts, mathematics, and social studies; (2) Increased collaboration between 
state instructional and computer staffs; and (3) resulted In state commitment 
to provide leadership In the area of microcomputer use through Inservlce 
programs and the publication of resource gulden. To date, the project has 
helped over SO Delaware teachers develop the knowledge, skills, and confidence 
to use computer technology In their language arts, mathematics, and social 
studies programs. 



In 1982, the Maryland State Department of Education (MSDF) launched 
a major effort to enhance teacher quality. A state task force was formed 
which examined data related to existing practice and future needs In the 



Outcomes 



3. Improve Teacher Quality 
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arean of teacher pre-8ervlce» Induction^ Inservlce^ recrullment^ retention^ 
and evaltiatlon. As a recult of recoiiiaendat''on8 made by this task force» 
several conoilttees were fonned» each charged with the developmc>.nt of programs 
or policies In specific areas: preservlce education^ use of the National 
Teachers* Examination^ beginning teacher evaluation^ Inservlce, recruitment » 
and overall implementation of policy and program changes, '^e work of these 
committees Is currently underway » with Initial phases of Implementation 
planned for 1986* 

This case describes how three RBS Exchange staff contributed to the work 
of the task force's committee on the evaluation of beginning teachers** 

Development of Competencies for Beginning Teacuer Evaluation 

One task force committee was charged with developing a system which 
would assess the on-the-job performance of beginning teachers and provide 
support to ensure their competence* The demonstration of teaching competence 
vas to be a requirement for a Maryland teaching certificate* Other commltw ^e 
^' re considering additional requirements: satisfactory coT^ipletlon of the 
required preservlce courses and passing the National Teachers* Examination* 



RBS was only Involved with the early work of the task force when It became 
concerned with the Issue of teachers Incenti/es* In 1983» national attention 
was caught by the Ideas of merit pay and career ladders for teachers* The 
MSDE Director of the Division oiF Certification and Accreditation asked RBS to 
find out what was being done In various states and large school s^fstems across 
the country » to analyze the relative successes of those programs » and to 
develop a resource paper that Ight Inform the task force » as well as state 
and local policy makers* RBS staff developed a paper» Rewarding Teachers: 
Issues and Incea^ tves^ In which the use of performance-based pay as an Incen- 
tive was discussed^ and six recently Initiated merit pay systems were de- 
scribed* The paper was widely distributed and contributed to state policy 
makers* decision not to Initiate normal systems of merit pay or career ladders 
In Maryland* 
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The committee was composed of representatives from various school 
districts, colleges, and MSDE, and was chaired by a school district staff 
person and coordinated by a MSDE staff person. It met monthly during the 
1984-85 school year, reviewing state and local programs, drafting a list of 
competencies, and beginning to consider how proposed teaching competencies 
might be validated and Implemented. Early In 19C5, at the request of MSDE, 
an RBS staff person Joined the state committee and participated In their 
regular meetings and working retre&ts. Since members had diverse backgrounds 
and no shared knowledge base, RBS made brief presentations on Instructional 
models and classroom management.* By June, a set of criteria had been drafted 
by the committee (version I). In July, a team of MSDE staff revised the 
criteria, organised them Into six domains, and defined them using over 100 
behavioral Indicators (version II). This set was distributed to the committee 
(Including RBS) and to about 20 MSDE staff for review. At the same time, RBS 
summarized the research that was available to support version II. 

In September, the committee discussed reviewer reactions and considered 
the research summaries and critique developed by RBS. It decided that further 
revision was needed. In response, RBS staff revised the criteria (version 
III) by organizing 17 competencies and 65 behaviors Into five domains: (1) 
Instructional planning and delivery, (2) classroom management, (3) teacher- 
student Interaction, (4) subject knowledge, and (5) assessment. RBS* 
revisions added criteria related to lesson planning. Independent and gulcad 
practice, and success rate* RBS further suggested the relative value of the 



*RBS* efforts In this area were supervised by the RBS ntate coordinator for 
Maryland, who also participated In some of the MSDE planning meetings and 
contributed to materials development. Other staff of the Regional Exchange 
carried out research and development taskst and provided training and 
assistance to the committee. 
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included in each. For Instance, 25 behaviors were grouped under five 
competencies In the domain of Instructional planning and delivery, but only 
two competencies and eight behaviors were In the assessment domain. 

Following review by the committee, version III of the criteria will 
>^ distributed to a number of Maryland educators for further suggestions. 
Additional cycles of development and validation of the performance criteria 
will be carried out during the winter and spring of 1986, as progressively 
larger numbers of people evaluate the criteria in terms of their importance 
and assessability. The final ver*Jion is expected to be developed by the 
summer of 1986. 

S upport for Beginning Teachers 

As the committee began to make progress in defining criteria for 
beginning teacher evaluation, they began to consider the support beginning 
teachers would need during the induction period to develop those competencies. 
They recommended that the program be entitled Beginning Teacher Evaluation 
and Development for Certification. They also recommended that appropriate 
training be developed for all the criteria. RBS provided support for one 
pilot program by developing a summary of the research on classroom management, 
in the form of a set of overhead transparencies and a script. The RBS 
materials have been incorporated iato the pilot inservice program. 

Outcomes 

RBS* contributions to date have increased state policy makers* awareness 
of the complexity of alternative •"approaches" to providing incentives for 
teachers to enter into and continue in f.he field. Increased MSDE staff and 
state task force members * awareness of current research on effective teaching, 
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and provided the© with a possible set o^ criteria against which beglm.xng 
teachers could be assessed. State policy makers have begun a process which 
will produce new criteria that beginning teachers will have to meet In order 
to be certified, and procedures for applying those criteria. In addition, 
they will be addressing questions related to the Implementation of those 
procedures, and the development and Implementation of Inservlce programs which 
will help beginning teachers meet those criteria. 

4. Improve the Quality of Local Teacher 
Supervision/Evaluation Systems 

In October 1983, the Governor and Secretary of Education of Pennsylvania 
published an Agenda for Excellence. It established as one of the priorities, 
teacher supervision and evaluation (TS/E). In 1984, the Pexmsylvania Depart- 
ment of Education (PDE) initiate activities to improve Pennsylvania 
administrators* and supervisors* sUils in supervising and evaluating 
teachers, as a means of improving */r.e quality of Instruction in the state's 
classrooms. To date» the .nitlative'« major accomplishment is the delivery, 
at 27 locations around the st't:e» of a two-day training academy which was 
designed to increase 1 800 supervisors* awareness of the roles and skills 
Involved in implementing effective TS/E programs. 

This case describes how Pennsylvania's TS/E initiative developed daring 
* 

1984 and how RBS contributed to it. 

Exploration of Possible Designs of the Initiative 

Responsibility for defining the specifics of che Governor's agenda 
regarding TS/E was assigned to PDE's Commissioner of Basic Education* During 



*Two RBS Exchange staff contributed to the design of the Executive Academy; 
the study nf exemplary TS/E system was a cooperative effort of RBS Exchange 
and Research and Evaluation staff. 



January and February 1984, an Internal steering conmlttee considered 
alternative ways of defining the TS/E Initiative. Since no special resources 
were eannarked for the Initiative, the committee •s challenge was to arrive at 
a design which could be delivered within existing resourcee and yet have 
notable Impact. 

In late February, PDE Invited representatives from the various state 
education associations (school boards, superintendents, principals, snd 
curriculum supervisors), and staff from RBS, to consider a proposed press 
release on the Initiative. The draft release described a cooperative effort 
of PDE and the associations which would encourage districts to strengthen 
their teacher evaluation procedures, so that marginal or incompetent teachers 
would either become more effective or be removed from the classroom. It 
specifically proposed that the associations would highlight TS/E in their 
conferences and workshops and that PDE would devote its Executive Academies 
for school year 1984-85 to TS/E. The associations encouraged PDE to present 
the purpose of the initiative as improving administrators' and supervisors' 
teacher supervision skills. 

PDF decided to include the topic of TS/E in an Executive Academy on 
Mathematics and Science Leadership scheduled for 1/te March 1984. RBS was 
asked by PDE to facilitate the discussion of the topic. On the basis of 
that discussion, RBS prepared a report which summarized the perspectives of 
district mathematics and science supervisors on the critical components of 
effective TS/E systems. The report also described supervisor** needs, as 
they sought to design, implement, aid maintain their TS/E systems. 

Development and delivery of the Work shop Program 

To develop the TS/E Academy program, PDE formed a planning group comprised 
of representatives of the intermediate units, the principals' associations, 

i 
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the University of Pittsburgh » and RBS. Its task was to produce a plan for the 
academyt including its goals» training activities^ and schedule. The planning 
group met twice. For each meetings RBS staff provided summaries of relevant 
research » information about exemplary TS/E practices » and ideas for the 
academy program. As a result of the committee's deliberations » an academy 
program was proposed which would cover two days and which would focus on four 
sets of skills: setting goals for supervisory activities^ collecting and 
analyzing data» conferencings and following due process procedures. 

To refine the program plan» PDE decided to have an advisory group review 
the plan and to pilot test the program twice. In early May, at PDE's invita- 
tion, 35 educators (principals, curriculum supervisors, staff developers, 
university professors, and association superintendents) met in Harrisburg to 
discuss the academy. The 35 educators were organized into four discussion 
groups led by either a PDE or RBS rtaff member. The comments of the groups 
supported the general academy plan; they did, however, suggest ways to develop 
the plan further. 

With the suppor.: of the advisory group, PDE staff scheduled a June pilot 
test. Presenters at the academy were drawn from Intermediate units, districts, 
and universities. RBS provided some draft exercises and took responsibility 
for cbtaining Participants* feedback. The 30 participants reinforced the 
developing plan and provided suggestions for further improvement. 

A second pilot was conducted in July 1984 at the Shippensburg Curriculum 
Conference. It involved 55 local administrators and supervisors. This pilot 
produced the strong suggestion from the presenters that they be provided more 
detailed plans and materials. Though PDE staff were reluctant to be "pre- 
scriptive," they accepted the suggestion and asked RBS to develop a resource 
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book. During August, RBS prepared a draft resource book. It Included a 
suggested agenda, the proposed sequence of training activities, and, for each 
activity, objectives, resource materials, guidelines, and suggestions. 

The "Presenters* Resource Book" was presented in September 1984 to the 
intermediate unit staff vho would be managing the regional academies. It 
served as the guide for 27 regional academies conducted in the 1984-85 school 
year. Evaluation data collected by PDE showed that the academies were very 
favorably received. 

Describing Exemplary TS/E Systems 

As a follcw-up to the academies, PDE decided to turn its attention to the 
characteristics of TS/E systems in the 500 districts In the state. Based on 
a survey of TS/E practices which PDE staff had conductf d during the fall of 
J 984, they concluded that districts needed, at a minimum, concrete information 
on how to design and operate an effective TS/E system— information which would 
be based on systems existing in the state. 

In February 1985, PDE leadership asked RBS to design and conduct a study 
of five exemplary school district TS/E systems which would provide the data 
required for the 1985-86 initiative. RBS designed a case study to obtain 
in-depth, descriptive information about the contextual history, goals, plan- 
ning process, development process, design components, funding, implementation 
time line /procedures, staff development, organization, day-to-day operations, 
evaluation, and perceived utility, effectiveness, and strengths and weaknesses 
of a representative sampling of exemplary Pennsylvania school district IS/E 
systems. This design was reviewed in two meetings with PDE staff in the 
spring of 1985. 
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with PDE*8 approval, RBS proceeded to develop and teoc three Interview 
protocols for district central office staff, administrators/trainers, and 
teachers. They were based In part on the protocols used In a Rand Corporation 
study of effective teacher evaluation practices (Wise, et al«, 1984, personal 
communication). ' ,y also Included 25 how-to-do-lt questions posed by 
Pennsylvania school officials In TS/E meetings and conversations. A three- 



phase study procedure was devised. 



• Descriptive TS/E system background and policy Information (e.g., 
policy manuals, training material. , observation Instruments, budget 
data) was solicited from each of the five districts. A brief pre-slte 
visit background Information questionnaire was also used. 

• Two researchers spent three days on-site at each district (six person 
days per r.lte) Interviewing school staff. At each site, central 
office staff and district trainers wera Interviewed for approximately 
three hours, administrators for one~and-a-half hours, and teachers 
(separately or In small groups) for a half-hour. In the four smaller 
dls" ^ts, the number of administrators (Including central office 
sta ind teachers Interviewed ranged from 7 to 10 and 31 to 43, 
respectively. In the largest dlscrlct, 22 administrative staff and 
51 teachers were Interviewed either separately or In small groups. 
Across the five districts, a total of "0 central office staff, 37 
administrators and/or trainers, and 194 teachers were Interviewed. 

• Follow-up contacts were made with selected district officials In 
cases where further clarification of the information was required 
in the process of preparing the final report (i.e., phase three of 
the study). In essence, district staff verified the accuracy of 
the program descriptions and implementation procedures cited in the 
report. 

RBS* final report presented a brief summary and an in-depth description 
of each TS/E system. It also provided a cross-system analysis along with 
discussion of the issues identified, recommendations for other districts 
considering the development or revision of their TS/E systems, and implica- 
tions for organizations planning on providing assistance to these districts. 
The report describes over 20 specific process factors or is^Mes critical to 
the initiation, design, startup, implementation, and malr enance of effective 




TS/E systems (e«g«, sources of fundings homophyly of trainers with target 
audience^ nature and duration of training and system phase in period, 
importance of system monitoring procedures). 

RBS staff met with PDE staff in October 1985 to discuss the publication 
and use of the study results. PDE may choose to disseminate selected aspects 
of the study to school administrators through their own publications. Incorpo- 
rate the findings in the content of rwo executive academies for school 
administrators planned for the 1985-86 school year, or use the findings to 
guide their technical assistance to districts that need help in upgrading 
their TS/E systems. 

Outcomes 

With consultants from the University of Pittsburgh and Pennsylvania State 
University, RBS staff increased state staff awareness of current research and 
theory related to teacher effectiveness and to teacher supervision/ evaluation, 
and helped them incorporate that research and theory into a workshop design. 
Subsequently, over 1,800 school administrators and supervisors, through their 
attendance at the state-sponsored workshop, increased their understanding 
of the knowledge and skills required for effective teacher supervision/ 
evaluation. In response to a state survey, 134 school districts reported 
that they planned to conduct additional inservice programs related to teacher 
supervision/evaluation. The survey '^Iso revealed that 103 school districts 
either have adopted and updated their teacher supervision/evaluation systems, 
or have plans to do so. 

As a result of RBS* study of exemplary TS/E systems, Pennsylvania 
leadership has become more aware of the conditions which must be present In 
a district for effective teacher supervision/evaluation to occur. It is 
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expected that Pennsylvania leadership, with RBS* assistance, will design 
materials and workshops to help local educational leaders consider the 
Implementations of the study's findings for their districts. 

5. Improve Educational Progra ms 
for Dellquent and Disruptive Yoath 

Since 1981, the Delaware State Interagency Agreement (SIA), the Depart- 
ment of Public Instruction (DPI), and the Department of Corrections have been 
Involved In a program to Improve the quality of education provided to approxi- 
mately 139 male and female youths, ages 13 to 19, Incarcerated In two Juvenile 
corrections facilities (Ferris School for Boys and Woods-Haven Rruse School 
for Girls). Their efforts resulted In a revised curriculum, a more highly 
trained Instructional staff, an ongoing school-based Improvement process, and 
awareness among state leadership of structural problems which are hampering 
educational efforts at the Juvenile corrections facilities. 

This case presents the origin of this program and describes how the SIA, 
with the support of other state agencies and RBS, Identified critical needs at 
those Institutions, and designed and Implemeiited activities to address them. 

Identification of Needs and Priorities 

In 1981, DPI and RBS staff observed the education programs offered at 
Delaware's two mental health and corrections facilities for youth and. In the 
process. Identified several areas In need of Improvement. The most critical 
of these was non-compliance with P.L. 94-142 nreclal education requirements. 
Subsequently, DPI, In conjunction with the Departmei^t of Corrections and the 
Department of Health and Social Services, decided to use the State Interagency 
Agreement (SIA), a small Independent agency, to define and resolve educational 
problems Identified at the two facilities. 
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To assist with this responsibility, the SIA organized early In 1982 a 
Planning Educational Development and Troubleshooting (PEDaT) team, comprised 
of representatives from DPI, the Brandyvlne and Red Clay Consolidated school 
districts, the Ferris School for Boys, the Woods-Haven Kruse School for Girls, 
and Research for Better Schools. The team first conducted an Indepth 
needs assessment which Identified at least ten specific areas In need of 
improvement. Examples of some of the needs Identified Include the following* 

• Develop better lln<>s of communication between the facility and 
parents. 

• Develop a working relationship between the facility and the public 
schools. 

• Transfer relev^^nt Information between the public schools and the 
corrections facilities. 

• Establish curricular planning to provide continuity in the child* s 
program (from previous placement, within the facility, and to subse- 
quent placement) . 

Members of the team were assigned to design activities which would 

address each of the needs* However, due to a lack of time and resources, team 

members made only minimal progress on the tasks. The SIA director, in 

response, dissolved the PEDaT team and asked RBS to assist his staff diractly 

in developing impiovement initiatives which would address the identified 

needs* 

Curriculum Revision and Special Education Program Im[j:ovement 

In the summer of 1982, SIA staff identified three areas for improvement: 
the school curriculum, the services provided special education students, and 
the level of staff expertise and performance* A four phase implementation 
plan was developed. 

*From the beginning of the project, RBS staff from both the Regional Exchange 
and the Evaluation Services component contributed co the proj )ct* The ser- 
vices of evaluation staff were covered by personal service contracts with SIA* 
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• Identify possible career paths for students and, given those paths, 
set goals and objectives which should be a priority for the schools. 

• Design a curriculum which would Include statements of goals, objec- 
tives, competencies, and Instructional plans. Provisions for meeting 
P.L. 94-142 special education requirements would be embedded In the 
curriculum. 

• Implement a staff development program related to phases I and II. The 
program would Include careful assessment of staff knowledge and 
skills, workshops \'hich address staff needs, and follow-up assistance 
to Individual staff members. 

• Design a student IE? form and tracking system, and Implement an 
Individualized educational planning process. 

Implementation of the Plan 

In 1983 and 1984, the two schools* staffs, supported by SIA and RBS staff 
worked through the phases of the plan. They Identified possible career paths, 
given their students' educational histories, and used them to establish three 
possible goals for th^ schools' educational programs: (1) prepare students to 
be successful upon re-entry Into a public school educational program, (2) 
prepare students for vocational training, and (3) prepare students for entry 
Into the world of work. 

With this framework, the staffs reviewed ability and achievement data 
for the studentG* Their analysis showed that the student body had a normal 
distribution In general ability, that their reading achievement scores varied 
widely (IrS to 12.9 In grade equivalent scores), and that their mathematics 
achievement scores were very low and more clustered (3 to 6 in grade equiva- 
lent scores). This analysis was used to structure the revision of the schools 
basic skills /curriculum, making It more responsive to the range of student 
ability and achievement. It also was used to Integrate more completely the 
basic skills and vocational components of the curriculum. 
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The curriculum revision activities were conducted as an Integral part of 
a staff development program for the schools* teachers. The program developed 
their ability to analyze tests, revise objectives based on test results, 
develop course and lesson plans, and select and use appropriate Instructional 
materials. In addition, DPI, with the assistance of RBS, sponsored workshops 
for the schools* staff to help them understand and address Individual student 
differences (e.g., learning styles) and develop more effective group process 
skills. There were also workshops which helped different subject matter 
teachers use alternative Instructional materials and systems. For example, 
the vocational teachers were trained to use the Individualized Instruction 
syster developed by the sf^ff at Hodges on Vocational and Technical School. 

Finally, school staffs addressed the need for an Instructional planning 
and Information system which would meet the requirement? of federal special 
education law and which would document student progress for parents and for 
schools which students might attend, after completing their term at the cor- 
rections facilities. To these euds, the staffs designed an individualized 
educational plan (IE?) form, prepared lEFs tor all students, and then used 
them to structure the education program they provided. 

Design a Structure for Ongoing School Improvement 

As the school staffs successfully x^stituted significanc change in their 
curriculum, instructional planning processes, and classroom practices, SIA and 
RBS staff asked the schools* principal to consider ways the faculties could be 
organized for ongoing improvement. The decision was made to establish a 
school Impi. 7ement coordinating council, which would identify developing 
school problems, obtain suggestions and ideas from all staff, and design and 
implement activities to resolve those problems. The council was established 
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during the summer of 1984, and It o^'ganlzed Itself into three committees: 
managevnent^ curriculum, and staff development. SIA and RBS staff served as 
advisors to the council^ during the remainder of 1984 and early 1985. 

Evaluation Services 

In addition to providing planning and Implementation assistance with all 
aspects of the project, RBS provided a number of evaluation services as a 
result of a contract with SIA. RBS analyzed the results of a battery of I.Q. 
and basic skills achievement tests which had been administered to the schools* 
students » In order to inform both curriculum development and individualized 
educational planning activities. Subsequently^ RBS developed and helped 
administer a test designed to assess students* achievement of the objectives 
of the Individualized Learning for Adults programs^ and those on the Delaware 
list of minimum competencies. RBS also evaluated specific training events. 
Finally, it prepared interim reports ^hich were consolidated into one progress 
report and» in the fall of 1985» prepared a final report describing project 
accomplishments and making recommendations for future improvements. 

Outcomes 

As a result of fhis cooperative project involving DPI, S'^A, and RBS 
staff, Delaware's Juvenile corrections facilities made a number of significant 
changes in management, program^ and practice. Specifically, educational goals 
and objectives were established » a framework for a comprehensive curriculum 
which would address the needs of individual students was developed, and an 
individualized educational planning process and a system for documenting 
student progress was instituted. In addition, a coordinating c. tncil was 
established as a mechanism for ensuring ongoing sjhool improvement. Through a 
series of staff development activitiest the schools* faculties acquired 
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knowledge and skills which ve^d required for the abov j tasks as well as ones 
which enabled them to worl. more effectively with students* Finally, these 
loprovenents within the schools dramatized for state educational and cor- 
rectlont' leadership major structural Issues assoclat.-'d M^th the rehabilitation 
of delinquent youth which they are now beginning to address. 

^. Improve the Quality of Education Provided by Urban Schools 
Governor Kean's state-of-the-state message to the New Jersey legislature. 
In January 198A, enunciated a clear educational priority; "Urb/'.n education 
deserves our attention. And, It gt£ It." The focal point for the 

Governor's campaign to improve inner city schools became the state depart- 
ment's Urban Initiative, launched in March 1984 after a full year of planning. 
The initiative has now been underway for eighteen months. Expenditures 
related to the initiative have exceeded 12 million dollars, most of the 56 
urban districts in New Jeirey have been involved in some aspect of the initia- 
tive, and well over 100,000 students have participated in new programs offered 
as a result o^ the initiative* 

This case describes the work of the New Jersey Department of Education 
and R3S* role* in supporting the Deprtrtmenf as it planned, d3veloped, and 
began to x^iplement the Urban Initiative. 



*The Urb€in Initiative involved staff from all RBS projects. The Director cf 
the Urban Development component served on the Urban Education Advis'^ry Commit- 
tee and was responsible for the 1983 survey. The New Jersey State Coordinator 
provided planning assistance. The New Jersey Dissemination Specia'''<st contri- 
buted to the Urban Education Seminar, developed the research dige& and was 
responsible for the Urban Sourcebook . The actual preparation of souicebook 
materlale Involved four other Exchange staff. Fiela studies staff conducted a 
field agent training program. Basi <9kllls staff contributed to the seiainar 
and follow-up training for urban districts interested In Achievement Directed 
Le^iership. Evaluation staff provided technical assistance to the urban 
Initiative. 
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Planning the Initiative 

Upon taking office In the summer of 1982, the Comm''.38loner of Education 
established an Urban Education Advisory Committee to help him consider urban 
education Issues. He asked RBS staff to serve on the committee. At Its 
mepvlngs In January and March 1983, the Commlttee^s members presented a 
variety of Ideas about how the state department could help urban districts and 
schools Improve their performance. One central recommendation was for the 
department to use the results of educatloi^al research to forter the design and 
Im^lei entatlon of urban school Improvement programs. The committee also 
encouraged the Department to survey the New Jersey urban superintendents to 
have thetu Identify the critical Issues. 

During the spring of 1983, RBS conducted the survey of urban superinten- 
dents. That survey Identified the full range of issues which the state could 
address — for ex&iiq>le, student attendance, disruptive student behavior, basic 
skills achievement, and employment of urban youth. 

To test Interest In rescarch-baseu urban school Improvement programs, the 
Department sponsored. In May of 1983, a two-day Urban Education Seminar. The 
seminar showcased four urban school Improvement programs which were targeted 
at Improving basic skills performance: ^1) Achievement Directed Leadership, 
developed by RBS and implemented by the New Brunswick (NJ) Public School 
District; (2) School Improvement Project (SIP), developed by the New Yo-k City 
Public Schools and based on the research of Ronald Edmonds; (3) St. Louis 
F tblic School Project, based on the research and development work of Rufus 
YoL ^, one of the school district's associate superln .endeuts; and (4) 
Effective Urban School Practices, developed by Lawrence Lezotte cf the Center 
for School Improvement at Michigan State University. 
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RBS stf.ff lielped the Department plan and deliver the seminar* In addi- 
tion to helping It Identify effective urban school Improvement programs and 
develop the 8em.'!nar*8 agenda, RBS staff prepared a digest of the effective 
schools research, Implementing the Effective Schools Research , which was 
mailed to each participant prior to the meeting* 

The success of the seminar encouraged the Department to plan a major 
statewide urban school Improvement Initiative* The Commissioner assigned his 
Assistant Commlsslonar for Educational Programs to lead the development 
effort. Over the next six m< :hs, the Assistant Commissioner and his staff, 
working directly with the Codiinlssloner, developed the plan* RBS, throughout 
this period, reviewed draft materials for the plan and provided suggestions 
for Improving them. 

The project, entitled An Urban Initiative , was formally launched by the 
governor at the March I98A meeting of the state board of education* The 
Initiative was divided Into two related components* The first component. 
Operation School Renewal, called for Intensive state assistance to three pilot 
districts that agreed to mount major improvement efforts focused on five 
objectives: improve student attendance; reduce disruptive student behavior; 
Improve student achievement In reading, writing £xid mathematics; expand 
employment opportunities for students; and lncrea?e the effectiveness of 
school principals. The second component called foi: the Department to work 
collaboratively with selected urban districts In one or more of ten problem 
areas: school attendance, disruptive youth, basic skills, youth employment, 
drug/alcohol abuse, special education, youth dropout, computer Instruction, 
compensatory/bilingual education, and writing Instruction* In addition, 
pertinent Information related to those ten areas v^as to be shared In an 
Information network Involving all 56 urban dl&trlcts In the state* 
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The Assistant Commissioner credits RBS for several Important elements of 
the plan; the plan's focus on clear objectives for which state and local 
educators could be held accountable; the ccjmltment to a long-term, multi-year 
effort; the design of the Initiative as a collaboration of the state and 
districts; and the Inclusion of a strong evaluation/assessment component, 
conducted by an external source. (Rutgers University became the Initiative's 
evaluator.) 

Developing the Initiative 

Soon after the release of the plan, the Department bezan the develop- 
mental work needed for successful Implementation of the Initiative. Most of 
their attention at the outset was focused on Operaticu School Renewal. An 
immediate priority was the desigi and implementation of a process for select- 
ing the three urban districts to participate in the renewal program. 

NJDE staff designing the selection process had to consider a number of 
political and technical issues. While most school districts in the state 
welcomed the special attention and extra resources that could be gained 
through participation in the initiative, they also feared the stigma of t)eing 
labelled "high-need" districts. Also, the process had to be impartial, free 
of political interference, and sensitive fo differences in district size. The 
Department decided that the best way to deal with these issues was to appoint 
a comuiittee of external experts (both educators and non -educators) to help 
with the design and conduct of the selection process. 

RBS staff was asked by the Commissioner to serve on the site selection 
committee. The committee determined the criteria for rating proposals, read 
and discussed all proposals, and conducted site visits to the six districts 



under final consideration. In June 1984, the Commissioner accepted the 
committee's recoimnendatlons that Trenton, West Orange, and Neptune should be 
the three districts selected for Operation School Renewal. 

In addition to selecting sites for Operation School Renewal, the Depart- 
ment's pirn called for each of the selected districts to generate a three-^year 
Improvement plan. To help the Department clarify its Interest, RBS developed 
a paper entitled "Planning for the Implementation of Operation School 
Renewal." This paper provided much of the background and rationale for the 
Department's guidelines for the development of the three-year action plans. 
Those guidelines requested plans not only from the districts hut also from 
each school in each district. They also suggested the creation of "renewal 
te^md" in each school and district to develop the plans and oversee their 
implementation. 

T'iaplementing the Initiative 

During the summer and fall of 1984, districts worked on their initial 
three-year plans. The" : were then submitted to the Department and approved in 
November 1984. 

As work began at the district and school levels, the Department began the 
design of support structures and activities. The Department assigned to its 
three Regional Curriculum Service Units (RCSUs) responsibility for organizing 
training programs useful to the participating districts and schools. In 
addition, the Department conducted a series of institutes for the principals 
of the 40 participating schools. In support of these activities, RBS 
conducted a field agent training program for state and RCSU staff, and also 
contributed to a series of workshops sponsored by the Department for district 
staff on improving student writing performance. 



In the fall of 1984, tl ^ Department asked RBS to develop materials which 
would provide urban districts and schools with information about programs 
which effectively address one or more of the objectives of the Urban 
Initiative, In response, RBS developed The Urban Initiative Sourcebook; A 
Discussion of the Literature and a Directory of Practices and Programs , The 
sourcebook was addressed specifically to administrators and teachers in New 
Jersey's urban districts. The first section revi2ws the research on effective 
schools and classrooms, and discusses the skills needed by the principal in 
the areas of instructional leadership, administrative management, and school 
Improvement. The second section presents a directory of exemplary practices 
and programs for each of the content areas. The third section provides 
guidance tc district staff in the managemt of school Improvement, 
bynthesizes topics which research suggests need to be considered in any effort 
to bring about systematic change and improvement in schools, including under- 
standing the change literature, planning implementation, providing leadership 
for school improvement, selecting implementation strategies, and designing and 
conducting staff development efforts. The sourcebook has been dissemii^ated to 
all 56 urban districts in the state, and the Department and RBS are currently 
planning a training program to help district and school staffs use it in 
updating their improvement plans. 

Assessing the Initiative 

In May 1985, the Department organized a retreat to assess the initiative 
and to plan new directions. Every phase of the initiative was examined during 
the retreat (e.g., business and industry cooperation, higher education 
involvement, the use of research outcomes, the role of the RCSUs, and the 
results of evaluation studies). RBS staff served as chairperson and 
facilitator for the retreat, focusing the discussion, clarifying issues, and 
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sunnarlzlng outcomes of each session. Other RBS staff gave substantive 
presentations on the use of research outcomes and on strategies for conflict 
resolution. The results of the retreat were sunmiarlzed In an end-of-the-year 
report Issued In August 1985. 

In the spring of 1985, Department staff visited all forty schools In the 
three selected districts to review the progress made In Implementing their 
plans, discuss with teachers and administrators their problems/concerns, and 
plan for additional assistance and resources. 

Outcomes 

New Jersey's Urban Initiative has now been underway for eighteen months. 
To date, Its primary outcomes have been related to state and local plan^-ilng, 
the development of supporting materials and structures, and the Initiation of 
local Impiovement plans. Specifically, the Department has established the 
Improvement of urban education as a top priority, established goals for the 
initiative, described a two-component strategy for achieving those goals, and 
obtained funding for selected aspects of the plan. The three urban districts 
selected for Operation School Renewal have developed Improvement plans at both 
district and school xevels, and have begun to Implement them. In support of 
their implementation activities, the Department has develope<^ Information 
resources and is providing a series of training and technical assistance 
services. The work of the next several years will tell whether these efforts 
will result in qualitative change in school and classrooms practices which, in 
tuin, will improve stude4.t attendance, * -ihavior^ and achievement. 

7. Improve the Effectiveness of Local Chaptur 1 Programs 
Delaware, Maryland. Nf^w Jersey, Pennsylvania, the District of Columbia, 
Virginia, and West Vitgin*.!*^ with the support of Research for Better Schools, 
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the Appalachla Educational Laboratory, and the Region I Technical Assistance 

Center (TAG), undertook a federally-supported one-year project to develop and 

field test a Chapter 1 program Improvement process. The project, known as 

MAGIC 1, achieved Its development objectives and alec trained more than 140 

state and local Chapter 1 staff to Implement the process, conducted program 

visits to 68 school districts, provided those districts with suggestions on 

how to improve their programs, developed a cadre of 18 team trainers, provided 

^h orientation to the process to over 250 Chapter 1 staff from across the 

country, ^nd initiated follow-i.p activities in most of the participating 

states. Throughout the project, RBS served as chief designer, product 

* 

developer, and trainer. 

This case describes the Magic 1 project in terms of an eight-step 
development process: initiation, pre-award design, development, training, 
field test, revision, transfer, adaptation, and extension. 

Initiation 

As a result of negotiations between NI£ and fedeial Chapter 1 staff, the 
regional exchanges were asked in the fall of 1981 to organize and conduct 
seminars for state and local Chapter 1 staff on the topics of effective 
teaching, staff development, and technical assistance. Due to its locat on 
and Interest, RBS served as the host for the East Coast seminar, which was 
held in Philadelphia in January 1982. That seminar stimulated informal 
discussions among Chapter 1 state leaders and the RBS Exchange director about 



*Five Exchange staff worked together on this activity. Three focused their 
energies on development tasks, while two focused their energies on training 
and implementation t&sks. 
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ways they could collaborate* Coincidenc with these discussions, the Secre- 
tary of Education announced, in the fall of 1^82, his initiative to encourage 
state Chapter 1 staff to focus energy and resources on program improvement 
and his decision to allocate discretionary funds tor this initiative. In 
response, the state Chapter 1 directors of Delaware, Maryland, Pennsylvania, 
Virginia, West Virginia, and the District of Columbia, and, at their inv - 
tation, staff from AEL, RBS, and the Region I Technical Assistance Center met 
in Harpers Ferry in May 1983 to explore the possibility of a project which 
would meet both the Secretary's intent and their individual interests. Their 
d'^liberations resulted in a draft project plan with two primary objectives: 
(I) to develop materials and instruments which would help local Chapter 1 
staff identify strengths and weaknesses in their programs, and (2) to field 
test those materials and instruments in a significant number of across-state 
program visits conducted by trained Chapter 1 staff. The group appointed a 
writing team to prepare a detailed prv)ject plan and develop a proposal for 
federal funds. The writing team, which included RfiS staff, prepared a 
one-year plan. It project:ed an expenditure of over $300, OOu of inkind staff 
time and resources, and it requested $80,000 in federal funds to help cover 
the costs of the planning meetings, the training of Chapter 1 visiting teams, 
and the across-state program visits. 

Preaward Design 

Gambling that the U.S. Department would fund the proposal, RBS staff 
initiated work on a number of design tasks during the summer of 1983. It 
developed a framework of 13 factors which research suggested may affect 
Chapter 1 student achievement. The framework reflected a backward mapping 
logic, citing first those student-related factors which could be good 




predictors of year-end achievement; then, classroom-i elated factors which 
could be Influenced by the teacher; then, program, school, and district 
related factors which could Influence what teachers do. In addition, RBS 
staff prepared a suimnary of the research they had used to develop the 
framework, a list of the methods Chapter 1 staff could use to collect 
Information about the extent each factor was present for a specific group of 
Chapter 1 students, and a guide describing a process for organizing and 
conducting program visits. With the announcement In late September 1983 of 
the award of federal funds, RBS mailed copies of those materials to the 
participating states and support agencies. 

Development 

The development period began with a two-day workshop for project leaders. 
The project leaders systematically worked through the proposed framework of 
factors, making suggestions for revisions; selected what they ^elleved would 
be the most feasible data collection methods from the list of possibilities; 
and critiqued the proposed process steps and the format of the guide describ- 
ing those steps. They decided to pilot the process In two districts before 
they Initiated the field tes To allow for the pilot, they scheduled the 
training of Chapter 1 visiting teams for December 1983. They also agreed on 
how they would select and organize the program visiting teams, and they 
designated AEL staff to facilitate the planning of the team training. 

Based on the leaders* suggestions, RBS staff revised the framework of 
factors and the guide. They also developed the Instruments. These tasks were 
completed In the three weeks between the workshop and the pilot test. RBS 
staff participated In both pilots, orienting the teams which would try out the 
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process and Instruments » and observing their Interviews, classroom observa- 
tions, and exit conferences. The pilot test suggested a number of modest 
revisions. Thet^e were reviewed by project leaders at a November planning 
meeting. RBS staff cade the revisions and provided the states with camera- 
ready copy of the materials to be used In the team training. 

Team Training 

The training program was conducted In mid-December j.983, with 120 local 
and 20 state Chapter 1 staff participating. It began with orientations to the 
project and process, and an Introduction to the factors. It Included sessions 
on conducting Interviews, observing classrooms, summarizing Information, and 
conducting an exit conference. It culminated with team planning of their 
across-state visits. 

All project leaders assumed responsibility for one or more training 
sessions* RBS staff contributed to three sessions. They Introduced the 
program Improvement process and the factors, assisted with the sessions on 
conducting interviews, and facilitated state meetings at which personal con- 
cerns were addressed. 

Field Test 

Between February and May 1984, the teams made 68 across-state program 
visits. RBS staff observed three tea& visits (those to Harford County, 
Maryland; Marple-Newtown, Pennsylvania; and Washington, D.C.). RBS staff 
served as substltrte team members on visits to Brandywlne, Delaware; and 
Philippe, West Virginia. 

To obtain Information from team members, RBS staff prepared and distri- 
buted feedback forms on the process, guide, and Instruments; and on the Impact 



ERIC 



53 65 



of the program visits. RBS analyzed the Information received from 62 team 
members, prepared a summary report, and presented the findings and their 
possible Implications at a June 1984 meeting of tne project leaders* 

In a complementary effort, staff from the Pennsylvania and West Virginia 
Chapter 1 units and from the TAC undertook an analysis of completed Instru- 
ments and school reports. That analysis suggested Items and factors which 
most discriminated between high and low performing Chapter 1 programs. 

Revision 

RBS was assigned the tasks of revising the project *s products and 
developing a resourcebook for team trainers. To check their perceptions and 
revision plans, RBS staff Involved a small ad ho;: group team leaders to 
review both recommended changes and draft revls-" s. RBS staff also had the 
project leaders review the revisions at their August 198A meeting. The 
results of this effort was a simplified framework of factors (11 instead of 
13 factors) and clarification of some of the factor definitions; some modest 
additions to the guide; a new set of Interview forms (organized by factor); 
and a resourcebook for team trainers which provided lesson plans for ten ob- 
jectives, scripts for presenters, worksheets, directions for team role plays, 
and a videotape for teaching the coding of student behavior. 

Transfer 

The project leaders decided to undertake two major events to develop the 
capability of others to use the project *s products to implement the Chapter 1 
program Improvement process. First » at the end of September 1984, with RBS 
staff serving as trainers, 18 local Chapter 1 staff who served on the visiting 
teams were prepared to be trainers. Second, in May 1985, project leaders and 
RBS sta.<:f conducted a presession at the International Reading Association 
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convention for over 300 'participants from state and local education agencies 
across the country. The participants received complete sets of the project's 
products and an orientation Ir their use. 

Adaptation and Extension 

£\.9 clx statef« pa'^ticlpatlng In the project have each made their own 
use of project rssults. Delaware, Maryland, Virginia, and the District of 
Columbia have undertaken dissemination, statf development, and monitoring 
activities which reflect the work of the project. West Virginia has made 
substantial revisions In its nonltO'«,lng process, which now focuses on program 
Improvement and Involves both state and local Chapter 1 staff on the monitor- 
ing teams. Pennsylvania has asked RBS to help adapt the process and products 
to Pennsylvania's needs. To date, the process and guide have been revised, 23 
local and 4 state Chapter 1 staff have been trained, and the revised process 
Is being Implemented In six low-performing school districts. 

Outcomes 

RBS* contributions to the MAGIC 1 project increased the awareness of 
many persons associated with Chapter 1 of the factors which research suggests 
may Influence Chapter 1 students* basic skills achievement. These persons 
included state Chapter 1 leaders from the six project states as well as those 
attending the IRA presession. They also Included the staff of the 68 dis- 
tricts involved in the progrpxi visits ^s well as the staff in those districts 
now involved in state adaptations. In addition, RBS helped state and local 
staff develop the interview, observation, and analysis skills needed to 
implement the program Improvement process. 

Districts which have participated in the program improvement process have 
informally reported to state Chapter 1 leaders that they have made a variety 



of changes as a consequence of the process. These have Included: Increased 
communication and collaboration between regular and Chapter 1 staff, changes 
in scope and sequence of the basic skills curriculum, changes In Instructional 
materials being used. Increased attention to test results and their use In 
Instructional planning, and changes In hov Chapter 1 teachers are observed and 
supervised. Several states a^e developing plans to explore the effects of 
tb se changes In practice on Chapter 1 students* achievement scores. 

8. Increase Educator* s Awareness and Understanding of Research 
Related to the Teaching of the Basic Skills and Science 

The Research and Development Exchange collaborated In the development and 
dissemination of a series of publication's which summarized current research 
related to teaching the basis skills and science. RBS actively participated 
In the collaboration. As a result, educators in its region became more aware 
of current research related to the teaching of oral and written conmunlc£itlon 
skills ana science, and were able to participate in training events aimed at 
helping them apply that knowledge. 

This case describes RBS* activities in support of the development and 
dissemination of three publications: Research Within Reach: Oral and Written 
Communication , Research within Reach: Science Education , and Research Withi n 
Reach; Secondary School Reading . 

Research and Development Interpretation Servicers Developmental Process 

The Research and Development Interpretation Service (RDIS) was one of the 
central support projects funded as part of the original R&D Exchange. Its 
task was to create a series of publications that would communicate to practi- 
tioners research-based findings related to several of the basic skills, and to 
work with the regional exchanges in the dissemination of those publications. 
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RDIS devised a multi-step process to ensure that the needs of classroom 



teachers were addressed In the publications. The process Involved: 

• soliciting conf'^.nt questl^^ns from teachers vl^: phone Intervlr.ws^ 
questionnaires » and/or ^.orkshops 

• presenting those questions to an advisory panel of content experts who 
cati^'iorlze and prioritize the questions and determine If research- 
based answers could be prepared 

• reviewing the R&D literature to develop the knowledge base needed to 
respond to the questions » developing an annotated bibliography » and 
creating portfolios of relatp.d support materials 

^ pieparlng draft responses to question sets (Interpretive reports) 
which Include a review of the relevant research^ a discussion of 
classroom iq>llcatlons» a^' recommendations to teachers for classroom 
Implementation of the research 

• revising* .he Initial draft based on reviewers* comments (reviewers 
Include the advisory panel and also Involved school » ^nlvsrslty^ 
8tate» Intercdd^^te service agency » and regional exchange staff), 
printing copies » and disseminating the reports through workshops 
conducted by the regional exchanges » state, intermediate service 
agency » and district staffs and through professional association 
pub!*lcatlons. 

Tills process has evolved over the past eight ytars. The first three 
documents developed (Research Within Reacn; Elementary Reading (1978) » Re- 
search Within Reac h ; Elementary Mathematlc (1980) » and Research Within Reach; 
Secondary Mathematics (1982)) "/ere prepi^red nrlmarlly by RD S staff. In late 
1979, RDIS and regional exchange staff decided that a strategy was needed to 
create both broader ownership and a larger market for the publications. 
Accordingly, agreement was r/^ached to Involve regional exchange s^aff and 
their clients more directly In the development process. As a result. RDIS 
asked RBS and the other exchanges to make specific contrlbutlors to the 
development and dlssem^ Ion of Its ?:hree most recent publications. 
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Research Within Reach; Oral and Written Communication 



To support the deveAopment of the oral and written communication docu- 
ment, RBS staff Identified state, local, and higher educatl'.n staff In the 
four-state region with expertise/Interest In oral and written communication. 
In 1980, these staff were Invited to RBS for one !ay, during which the partic- 
ipants generated questions pertinent to the content area, and sorted and 
priority ^ed tnem. RBS staff the^ forwarded the quostions to RDIS staff, and 
subsequently participated In RDIS advisory comulctee meetings. When the first 
draft of the document became available In early 1981, the educators who had 
generated the Initial questions were Invited back to RBS to x^evle^ and cri- 
tique that draft. Their suggestions and concerns were comiaunlcated back to 
RDIS, where the^ were taken Into account as the publication was revised. The 
second meeting also provided an opportunity for sharing ano discussing a 
number of exemplary oral and written communication programs In the region. 

RBS staff worked collaV:;ratlvely with state and local educator^: to design 
activities which wo-ld Increase awareness and use of the document, and appli- 
cation of Its content In practice. Specif Ically^ RBS staff: 

• assisted during 1980-81 staff from Maryland and Delaware state educa- 
tion agencies, from a district language arts division, and from a state 
college with the development, testing, revision, and dissemination of 

a K-12 program in oral comrur.lcation skills, whivh Incorporated content 
from RDIS* oral and wrltfe.i coiumunicatiou product 

• conducted a w^rkshop^ in collaboration with RDIS staff, on research in 
oral and written communication xor parti 'pants at the 1982 East Coast 
Title I Basic Skills workshop, hosted by Vhe NETWORK 



*An Exchange staff member was asFlgned the responsibility to work with RDIS on 
the development of each publicatioii All state-related Exchange staff helped 
identify the educators in th^^ir states who would contribute to the development 
and dissemination activities. They also participated in regional meetings and 
frequently supported the planning and implementation of follcw-up training and 
dissemination activities. 
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• distributed 110 copies of the RDIS product to selected educators in 
the r;^glon 

• collaborated with the Nww Jersey Commissioner of Education and RDIS 
staff in 1984 to plan, develop, and implenent three two-day regional 
workshops fev New Jersey district staff on improving writing instruc- 
tion and assessment. Materials were drawn from the RDIS product and 
were included in an information packet for the workshop participants 

• planned vith NJDE staff in 1984 an awarenesf. session for NJDE and dis- 
trict staff responsible for improving writing irstruction K-12, and 
assisted NJDE staff with the development of a writing resource file 
for use by Regional Curriculi Ji Service Unit (RCSU) staff. Both 
activities used the RDIS product. In addition, NJDE obtained the 
galleys of the oral and written publication, printed 300 copies, and 
distributed them to New Jersey educators. 

In addition, RBS staff participated in several planning meetings conducted 

by RDIS staff in 1984-85. The purpose of these meetings was to develop a 

series of three-day turnkey training workshops to enable educators to use the 

RDIS publication in inservice programs. RBS staff assisted with the de^ipn 

and implementation of the workshops, and recruited ten educators (represen Ing 

state, intermediate, and local educators) from the region as participants. In 

return ::or hcving their training expenses covered to attend workshops in Ohio 

and Washington, D.C., the participants agreed t conduct one or more oral and 

written communication workshops fo*- their respect^.ve client groups. 



Research Within Reach; Science Education 

In February 1983, RBS staff formed an ad hoc science committee to ascist 
RDIS staff develop a Research Within Reach document on science education K-12. 
The commit lee wi\s cciLprlsed of science educators from state, local, and higher 
education agencies and from the National Science Foundation. They identified 
key issues and collected and organized, questions from teachers teaching 
science K-12 in schools in the region. RBS staff forwarded thoue questions to 
RDIS. From mid-1983 through mld-1984, RBS staff participated in RDIS* science 
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consultant panel meetings to provide feedback from the committee and to review 
draft materials* In September 1984, RBS and the committee met to consider the 
first complete draft of the document; a summary of the recommendations result- 
ing from that discussion was forwarded to RDIS. In November 1984, RBS staff 
reviewed the final draft of the document. 

Planning for the dissemination of the science education product began In 
late 1984. RBS participated In an RDIS-sponsored meeting at which alternative 
dissemination strategies. Including turnkey training workshops, were explored. 
RBS subsequently convened another meeting of regional science educators to 
discuss preliminary dissemination plans and participation In proposed ROIS 
turnkey training events. 

In late 1984 and e«.rly 1985, RBS collaborated with RDIS and NEREX staff 
on the development and conduct of a rcltnce and mathematics turnkey training 
workshop in Boston. RBS successfully recruited several science educators from 
state, local, and higher education agencies to participate In the workshop and 
to conduct one or more follow-up training acfivitics for their respective cli- 
ent groups. RBS staff served as workshop facilitators and helped participants 
develop and refine specific follow-up training activit> plans. 

Throughout the remainder of 1985, RBS staff participated in a number of 
dissemination activities related to the science education product. Sp*2cif- 
Ically, RBS staff; 

• planned and conducted with PDE, Bucks County lU, &nd Schuylkill County 
lU science staff a workshop at PDE*s annual Shippensburg Curriculum 
Conference. The workshop, which drew heavily from the RDIS product, 
was attended by 23 science) supervisors from Pennsylvania school 
districts. Participants developed dissemination and/or application 
plans as part of the workshop activities 

• assisted New Jersey science educators, representing state, local, 
and higher education staff, to design and conduct summer institutes 
for teacbfc^.^ and administrators using ROIS science and mathematics 
products. Over 300 educators attended the institutes at Edison and 
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Stockton. Included on the agendas of these institutes were such 
topics as: major purposes and outcomes of science educaclon, science 
In relation to other disciplines, successful science and mathematic 
programs, effective instructional strategies, classroom factors 
affecting student attitudes, and the role of computers in science 
courses 

• conducted two meetings with Delaware state, local, and higher edu- 
cation staff to inform them of the RDIS materials and discuss ways of 
using the materials in inservice programs. Subsequently, RBS staff 
assisted state staff with the development of a "Did-You-Know" publica- 
tion designed to inform Delaware science teachers of RDIS' findings. 
RBS staff also reviewed University of Delaware stsff's plans to 
incorporate RDIS content into the science education methods curricula 

• sponsored two meetings at RBS for educators from New Jersey, Delaware, 
Pennsylvania, and Washington, D.C. universities, museums, foundations, 
and zoos with interests in improving science education. These partic- 
ipants briefed each other on current activities, learned about the 
woik of RDIS, and explored ideas for using and disseminating the 
science product to other educators in the region 

• alstributed n50 copiea of Research Within Reach; Science Educati on to 
selected science educators in the region. 

"eacarch Within Reach: Secondary School Reading 

lo assist with the development of the secondary school reading ''ocument, 
RBS staff used the occasion of several reading conferences between January and 
May 19i!5 to obtain practitioners' questions. These conferences included: 
the Literature and Literacy Conference (Philadelphia) , the New Jersey Reading 

ssociation Conference (New Brunswick), the national meeting of the Interna- 
tional Reading Association (New Orleans), and a local chapter meeting of the 
International Reading Asdoc'ation (Newark, DE). At each of these meetings, 
RBS staff conducted sessions in which the RDIS process was explained and 
practitioners' questions were elicited. RBS staff presented these questions 
to RDIS staff for consideration in the development of the product. RBS staff 
also participatt in a RDIS- sponsored meeting in Atlanta, in September 1985, 
at rfhich the first draft of the document was reviewed and dissemination 
activities were discussed. 
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Upon Its publication in November 1985, RBS staff plan to disseminate this 
product through established state channels and through the states* reading 
associations* 



Outcomes 



As a re-ult of RBS* development and dissemination activities in support 
of RDIS* Research Within Reach documents, educators from state, local, and 
higher education staffs have been made aware of the latest research on oral 
and written communicate jn, science? and mathematics. They have had the 
opportunity to contribute their knowledge to the development of these docu- 
ments, and they hwe received, through RBS, turnkey training to enable them to 
assist other educptors to effectively use the RDIS products. They have, in 
turn, conducted training activities which Increased the understanding of other 
educators in the region of the contents of the RDIS publications and of ways 
of applying that content in their basic skills and science programs. 
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REFLECTIONS ON THE EXCHANGE EXPERIENCE 



RBS has completed Its eighth year of contributing to state educational 
Improvement activities. Itr view of states and their role In educational 
Improvement and Its vieia of Itself and how it can best contribute to state 
Improvement efforts have evolved steadily over those years. This section 
summarizes RBS' current perspective on these oatters. It Is organized Into 
three parts: perspectives on the states and educational Improvement, per- 
spectives on RBS and Its services to states, and perspectives on conditions 
affecting the Impact of states' and RBS' supporting activities. 

Perspectives on States and Educational Imr^-ovement 
RBS' current perspectives on the states and their contributions to educa- 
tional improvements can be summarized under four headings: state educational 
Improvement activities » state processes related to educational Improvement , 
coimnon substantive themes of st&te educational Improvement activities, and 
appreciation of differences among the states. 

State Educational Improvement Activities 

Over the last eight years, RBS has contributed to a vide range of state- 
Initiated educational improvement efforts. The cases, drawn from the last 
three years' efforts. Illustrate that range. Though each state Improvement 
effort ' 3 Its own unique combination of activities » RBS has come to see those 
activities as falling Into three broad types. 

First, state governments can establish new expectations regarding student 
learning outcomes and local educational practices. For example » they can 
specify skills studints should master; require students to pass a test measur* 
Ing those skills; require students co take and pass certain types of courses; 
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develop guidelines regarding course content; advocate certain planning* 



management, and Instructional pract:lces; and recognize teachers, schools, and 
programs which they believe are exemplary. These expectations can be embodied 
In lav» late board of education mandates, departmental guidelines, state 
tests, and various kinds of state recognition programs. They can artic- 
ulated by governors, chief state school officers, state board membi;rs, and 
other state leaders. 

Second, state govemmenrs can undertake a v;»^lety of activities such as 
the following to encourage local districts, schools, and staff to fulfill the 
Intent of a new expectation. 

• Prepare and disseminate Information about the new expectations and how 
to meet them. Examples of this activity are state-sponsored tele- 
vision messages on the l]iq[>ortance of parent Involvement, and 
state-developed booklets about the competencies students should be 
able to demonstrate. 

• Provide Indepth staff development programs. Examples of this activity 
are academy programs on such topics as teacher supervision/ evaluation 
and models of effective teaching. 

• Provide personalized technical assistance. Examples of this activity 
range from establishing a hotline to supporting on-site staff to 
providing technical assistance with respect to a particular Improve- 
ment effort. 

• Provide fiscal Incentives. Examples of this activity are small grants 
to help districts carry out Instructional Improvement projects and the 
funding of new remedial programs. 

• Provide support for I'^cal development/demonstration projects. For 
example, one state Is supporting comprehensive urban school Improve- 
ment projects, a second Is supporting local technology projects, while 
a third Is supporting Instructional Improvement projects. 

• Monitor local practices. Examples of this activity range from state 
staff review of required documentation from local districts to on-site 
visits to verify district compliance with law and code. 

• Threaten sanctions for low or non-performance. Examples of these 
sanctions are the withholding of a state-approved diploma for a 
student falling to meet course requirements or to pass a state test, 
and non-renewal of teaching llcenrns for teachers not leetlng recertl- 
flcatlon requirements. 
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Third, state governments can provide general services, such as the fol- 
lowing, which are supportive of local school Improvement. 

• Build and maintain networks of persons and agencies which share common 
school uprovement Intere «s and concerns (e.g., councils of superin- 
tendents, assistant superintendents for curriculum and Instruction, lU 
directors). These networks are used to exchange Information and 
experience, to Identify potential problems, and to develop shared 
goals . 

• Sponsor regular conferences and meetings to facilitate exchange of 
Information and encourage the exploration of Issues. 

• Provide Information services which facilitate the exchange of knowl- 
edge and experience. 

RBS views many of the current state educational Improvement efforts as 
primarily Involving activities related to establishing new expectations (type 
1) and to encouraging local educators to meet taose expectations (type 2). 
RBS has found this typology useful for analyzing the character and scope of a 
given state effort. Such an analysis has helped RES staff predict t^e poten- 
tial Impact of an effort (both the number of activities and the quality with 
which each activity Is carried out appears to be related to Impact). It has 
also enabled them to Identify activities to which It might contribute and ac- 
tivities which It might encourage state leaders to Initiate. 

State Processes Related to Educational Improvement 

Complementing RBS* view of state educational Improvement activities Is 
its view of the procesr^es state leaders use to determine what educational 
Improvement activities they will undertake. From RBS* perspective, these 
processes occur under two quite different circumstances. The first occurs 
within the context of existing state regulations, programs, and appropria- 
tions. Under those circumstances, state education agency leaders are the 
primary decision makers. They have the authority and resources, for example. 



1^ 



65 




to update testing programs, revise guidelines for course content, design and 
Implement staff development programs, or revise monitoring activities. Tn 
general, they undertake these activities In cooperation with representatives 
from associations. Intermediate service agencies, and school districts. They 
frequently obtain counsel from other state-level decision makers (e.g., the 
governor, members of the state board of education, legislators). They also 
tap the expertise of Institutions of higher education and organizations like 
RBS. 

The second circumstance, when school improvement activities require new 
legislation, mandates, and appropriations. Is quite different. The processes 
required for th^se purposes vary with each state and each Issue; however, they 
can be conceptualized In terms of four Identifiable phases. First, there Is 
an exploration phase (Phase I) during which concerns are i Ised, alternative 
course? of action are considered, and Information which might Inform the 
process Is gathered. Sometimes this exploration Is personal, for example, 
when a new chief state school officer visits a number of schools and local 
education leaders across a state. Sometimes this exploration Is public, for 
example, wlien legislative hearings are held to gather facts and opinions on an 
issue, or a governor appoints a task force to identify areas needing state 
leadership and action. Irrespective of how an issue is explored, the first 
phase culminates with the formulation of specific proposals for new state laws 
and regulations — proposals which suggest new expectations for districts, 
schools, staff, and/or students. Over the past few years, the state leaders 
who have most directed and controlled this phase of the political process have 
been the chief state school officers and the governors. 

The second phase (Phase II) is the period of discussion and debate 
regarding a specific proposal. Depending on the content and nature of the 
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proposal, that discussion and debate may focus on the legislature, the state 
board, and/or the state education agency. Active In this process are the 
state-level Interest groups (e.g., the associations of school boards, adminis- 
trators, principals, teachers, parents, taxpayers). This phase comes to a 
close when formal action has been taken: a new lav Is passed, a new regulation 
Is approved, or a new guideline Is promulgated. 

With a new expectation established, responsibility shifts to the state 
education agency (SEA) . It Is this agency which must help local districts and 
schools meet the Intent of the new law, regulation, or guideline. Ccicept* 
ually. It Is useful to distinguish between SEA planning and Implementation 
activities, though frequently they run parallel, or just flow Into each other. 
The planning phase (Phase III) Incorporates those activities which lead to 
decisions regarding what the SEA will do, what resources will be allocated, 
and who will be Involved. The Implementation phase (Phase IV) Is conceined 
with carrying ojt those decisions. In these latter two phases, as before, SEA 
leaders generally Involve others — for example, representatives of appropriate 
associations. Intermediate service agencies, school districts. Institutions of 
higher education, and/or R&D organizations like RBS. 

Over the past thrae years (Indeed, over the past eight years), RBS has 
found Itself prliuarlly contributing to state educational Improvement efforts 
which have been carried out within the context of existing state regulations, 
programs, and approyrla^ilons (sae Appendix A and cases 1, 2, 4, and 5). Yet, 
RBS has also had an opportunity to contribute to state educational Improvement 
activities which have required new legislative mandates, st^te board regula- 
tions, and/or appropriations. Some of these opportunities were described In 
three of the cases. 
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RBS staff contributed to Delaware's state plan for use of computer 
technology. That plan resulted In Increased appropriations for com- 
puter-related activities (case 2). 



• RBS staff contributed to Maryland policy Toakers' exploration of the 
role of Incentives In teacher quality and to Maryland's committee de- 
veloping new standards for teacher certification (case 3). 

• RBS staff contributed to the plan for New Jersey's Urban Initiative 
which was adopted by the star 3 board and which required additional 
appropriations (case 6). 



Common Substantive Themes of St^tf. Educational Improvement Activities 

Though each state has crafted Its own agenda for educational Improvement, 
RBS sees Its four states pursuing commo.: substantive emes. The following 
four themes have received the mr3t attention over t ,e past few years, and RBS 
believes they will continue to receive attention In the next several years. 

• Improve students' basic skills achievement . All states seek to help 
local districts and schools Improve students' basic skills performance 
by: (1) clarifying objectives and Identifying effective Instructional 
practices In the basic skills (I.e., reading, mathematics, and writ- 
ing); (2> instituting testing programs to assess students' skills at 
selected grade levels, ar In two states, requiring adequate perfor- 
mance as a prerequisite foi high school graduation; and (3) monitoring 
the use of state and federal resources targeted to helping special 
needs students acqulri the basic skills, and developing programs to 
help districts Improve their use of those resources (e.g.. Chapter 1, 
bilingual programs, some special education programs, and state compen- 
satory education or remedial programs) . 

• Improve curriculum. Instruction, and the use c" educational technolo- 
gy . All states are providing leadership In other areas of curriculum 
and Instruction by developing consensus on goals and objectives In 
each of the content areas; encouraging exchange of Information about 
effective Instructional approaches; providing guidelines, training, 
and other resources; and ensuring adequate assessment of student 
learning. They also establish course requirements for high school 
graduation. Over the last few years, the states have: (1) Increased 
graduation requirements In science, mathematics, and other subjects, 
jy Increasing the required number of credit hours and by Initiating 
honors programs or advanced levels of graduation certification; 

(2) revised standards and developed K-12 guidelines for many of the 
basic content areas; (3) provided training and support for the 
Improvement of content-specliic Instruction through sponsoring 
academies and similar Inltl 'tlves; (4) Initiated projects to Infuse 
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higher order thinking skills In the curriculum; and (5) Initiated 
projects which help schools apply microcomputer technology In selected 
content areas, and. In three states, established mlcrocompp^er 
training ci^nters for teacher b. 

• Improve the quality of tec? All states are Involved In and have 
Initiated activities aimed at Improving the quality of teaching. Some 
activities provide Incentives which encourage good teachers to stay In 
the professloni, and attract high quality college students to enter the 
profession (e.g., state-supported pay raises, career ladders, merit 
pay systems, and teacher recognition programs). Some activities are 
directed at improving the quality of new teachers (e.g., more rigorous 
standards for entry Into preservlce programs, new requirements for 
certification, the Improvement of college courses, requliement of a 
formal Induction period, and the creation of alternative routes to 
enter the profession for liberal arts graduates and adults Interested 
In making a career change). A third set of activities Is directed at 
Improving the performance of current teachers and facilitating the 
termination of Ineffective teachers (e.g., Inservlce programs, or 
programs aimed at Improving teacher supervision and evaluation sys- 
tems) . 

• Improve the effectiveness of schools at all levels . All states have 
considered the results of studies which have sought to Identify those 
characteristics which differentiated high and low performing schools, 
when the aocloeconomlc characteristics of their students were held 
constant (e.g. Brookover, Beady, Flood, Schweitzer, & Welsenbaker, 
1979; Edmunds, 1979; Rutter, Maughan, Mortlmore, Ouston, ^ Smith, 
1979; Welllsch, McQueen, Carlere, & Duck, 1978). Encouraged by their 
findings, the states have Initiated a number of related activities 
Including Delaware's School Standards and Monitoring Process, 
Pennsylvania's Long-Range Planning Guidelines, Maryland's Commission 
on Secondary Schools and local Elementary Excellence projects, and 
New Jersey's Urban Initiative and pilot School Effectiveness Program. 

All of the cases presented are directly related to these themes. 

By Identifying such common substantive themes, RBS has been able to de- 
velop knowledge bases and collect resource materials In anticipation of what 
It may be asked to contribute to several states' educational Improvement ef- 
forts. 

Appreciation of Differences Among the States 

XRS sees Its states undertaking similar types of educational Improvement 
activities which Involve i^lmllar decision-making, planning, and Implementation 
processes, and which are directed towards similar substantive ends. However, 
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RBS has also come to appreciate the differences among Its four states. These 



differences Include the size £* d complexity of their educational systems, the 
size of their state education agency and the kind of relationship Its leaders 
have with the local school districts, and the way the states* current agendas 
for educational Improvement have been established. Below Is a brief review of 
each of the states It serves. 

• Delaware Is a small state with approximately 111,315 elementary and 
secondary students cf which 91,406 are enrolled In public schools. 
The public school system Is organized Into 19 districts whfch operate 
167 schools. There are approximately 5,436 teachers employed by those 
districts. 

The state education agency has 67 staff. Its leadership works closely 
with the 19 school district superintendents. The state has Instituted 
a comprehensive testing program to monitor student basic skills 
achievement; It also conducts monitoring visits to each school build- 
ing every five years. It expects local schools and districts to make 
Improvements based on testing and monitoring results. Its staff also 
provides an ongoing program of Inservlce for Interested schools and 
districts. 

In 1983-84, the lleutenai.t governor (now governor) headed a task force 
which set forth 75 recommendations for Improving education. Current- 
ly, selected recommendations are being Implemented, for example, 
graduation requirements, curriculum standards, and standards T'lr 
certification. 

• Maryland has approximately 819,191 elementary and secondary students 
of which 682,155 are enrolled In public schools. The public school 
system Is organized Inco one city and 23 county school districts;, 
which operate 1,266 schools. There are approximately 37,437 tear.hers 
employed by these districts. 

Maryland has had stable state educational leadership since 1977; Its 
SEA has a staff of 394. It has developed a close working relationship 
with the 24 district superintendents. Under that leadership, Maryland 
has Identified a 3et of competencies which students are to achieve 
before graduation, established a testing program to assess their 
attainment, and worked with the districts to ensure that all students 
have the opportunity to acquire the required competencies. In addi- 
tion, the state has Initiated a multi-year program to encourage local 
use of effective teaching models. It has an ongoing program to 
strengthen course content. It conducts academies each summer aimed at 
helping principals to provide more leadership in the area of Instruc- 
tion. It la currently Involved In activities aimed at Improving the 
quality of teachers and the effectiveness of high schools. 
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• New Jersey has approximately 1,336,559 elementary and secondary 
students of which 1,147,841 qre enrolled In public schools. The 
public school system Is organized In 593 dlstrlc::s vjhlch operate 2,294 
schools. There are approximately 73,262 teachers employed by those 
districts. 

In the late 1970s and early 19808, NeJ Jersey's euacatlonal improve- 
ment activities were driven by a state Supreme Court decision which 
ordered the legislative and executive branch to define and Implement a 
"thorough anH efficient** syster: of erucatlon and to revamp how the 
state finances education. During that period, the state Initiated a 
minimum basic skills cest and a school Improvement process known as 
T&E. 

In 1983, a new governor and chief state school officer extensively 
reorganized the state education agency, which currently hpc a staff of 
appj^.. .lately 619. They Iia e also Ir.eMtuted a multi-faceted educa- 
ti ual Improvement p/ogram wnlch includes: eatabliphlng a more 
rigorous basic skills testing program, raising high school graduation 
requirements, plaimlng a program target on the 56 urban districts 
the stat^, increasing its mo'^ltorlng of schools and districts, and 
creating an alternative route to becoming a teacher. 

• Pennsylvania has approximately ? ^32,733 elementary and secondazy 
students of which 1,736,500 are enrolled in public schoolfl. The 
public school system is organized into 500 school districts which 
operate 3,600 rchools. There are approximately 102, 15t/ teachers 
employed by those districts. 

Pennsylvania has had three Secretaries of Education since the current 
governor took office ''a 1980. Each has been involved in reducing the 
size of th^ state education agency, which has lost over one-third of 
its staff positions and now stands at approximately 667. In the early 
1980s, the state undertook two major in:f tiatives. One encour:Lged 
districts . inscitute long-range planning tcr school imprjvement at 
the building level, while the other sought to revamp teacher educa* 
tion. 

In 1983, the governor with hif 'second Secretary of Education set forth 
an agenda of educational refctn entitled **Turning the Tide.** It 
included increased requirements for high school graduation; the 
institution or a baric skills diagnoscic testing program; initiatives 
to encourage distri<;ts to review and revise policies and practices 
related attendance, discipline, homework, teacher supervidon, and 
evaluation; an initiative to stimulate business-school partnerships; 
and continuation of efforts to iiLprove tef :her education. 

As these \.scriptions suggest, t^.. four states are dramatically different 

in flze. For every pu?lic school student in Delaware, there are approximately 

8 in Mary? and, M in New Jersey, anc 21 in Pennsylvania. And the states 



71 83 



>mpare similarly In nu.J)er8 of school bulHlngs and numbers of teachers. 
With respect to school districts, Delaware and Maryland have organized them- 
selves Into a small number of districts « 19 and 24, respectively. This 
structure allows &^ite and local education leaders to sit around the tame 
table almost mon^:hly to consider Issue? their educational systems face. In 
contrast, New Jersey and Pennsylvania hava 393 and 500 districts, respectively. 
These numbers pr^ ^nt state educat:'onal leaders with complex communication and 
monitoring problems. To address them, New Jersey has a system of 24 county 
offices ~7hlch Is designed for these purposes, and* In aadltlon. It has estab- 
lished three Resource Curriculum Service Units to provide technical assistance 
in support of ^^ate prior-^ties. On the other hand, Pennsylvania has a stem 
of 29 intermediate units which are governed by their membr^r districts, but 
which do help with communication between state and local leauership. 

Besides these structural differences, tue Scates differ in the stability 
of their state educutiona. leader ^ Delaware and Maryland have had stable 
leadership, which has enabled these leaders to identify ^ plan, and implement 
long-term educational improvement efforts, ar J tc involve local educational 
leaders in the process. In contrast. New Jersey and Pennsylvania have experi- 
en'^.ed significant changes in leadership and in the organization and staffing 
of their state education igencieii. Most recently, they have also experienced 
their governors playing a dramatically 2ore central role in setting the 
stacp^s educational improvement agenda. RBS sees these differences as having 
a significant impa t on how long a otate maintains an educational improvement 
effort, on the range of activities it undertakes, on the quality with which 
those activities are conducted, and, therefore, on the extent to which those 
eff jrts aflect local educational practice. 
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Perspectives on RBS and Its Se^^vlces 
NIE's original guidelines for the R&D Exchange, auu a relatea study (. t 
Associates' study of NIF's gcnaral purpose dlp*jsiiilnation projects) > def ne 
RBS' Exchange from a dissemination pe*-j^pectlve~a perspective which was 
reflected In the description of RBS' approach In Section I of this report. 
Based on feedback received from state leaders,* RBS has learned thdt th>^y view 
the Regional Exchange project from quite a different set o: perspectives. On 
the one hand, chey see the RBS Regional Exchange project as a unique resource; 
on the other, they see its existence to be a judgment on their c^pr* lllty^ 
This part describes both perspectives. 

RBS' Regl( » nal Exchange as a Resource 

State leaders' view of RBS as a resource is made concrete through the 
tasks they ask the laboratory to p«.rform. These tasks can be described 
both process and content terr.s. 

^v<^ )r%aci hP4?n asked to provide the following sen^lces to states. 

• I nformation services . RBS rtaff have ccA.lected Information pertinent 

0 a specif 1 * state leader's task, summarized that information in a 
fonr appropriate for that task, and presented the summary in person 
to the state leader.** 

• Planning assistance . RBS staff have helped state leaders design 
comprehensive school improvement programs as well as more limited 
state educational improvement initiatives. 



*RBS supported two studie.i of its activities. In 1980, Diana !/hitney shadowed 
RBS Exchange staff for thrae months. Her study described the kinds of activi- 
ties performed by RBS sta^.f» the dilemmas staff faced in their daily work, and 
factors Influencing wba** staff did. The study concluded with a list of impli- 
.^atlons. In 198A, Sheila Rosenblum interviewed state leaders with whom RBS 
id been working. In a memorandum to staff » she identified irsues which she 
chought the laboratory a^eded to consider as it planned future state assistance 
activities. This section dravs < >avil;^ on the findings of those studies. 

**The activity of collecting, organising » and summarizing information zoout 
the results of current educational R&D is a service in its own righl, but it 
l9 also an activity which supports all other services. 
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• Implementation-related services , RBS staff have helped state staff 
with the design aud coiduct of orientation and staff development 
programs aimed at helping local e'iucatlonal leaders Implement new 
practices. RBS ^as also helped state staff with the development of 
specific resource materials which will support local Implementation. 
Finally, RBS has helped state staff design and provide technical 
assistance In support of local Implementation. 

• Evaluation/research rervices . RBS staff have designed and conduct'ed 
studies alme^ at Providing Information which will help state leaders 
plan, Implemeat, and refine state educational Improvement programs. 

In addition, states see RBS as a "convener," an agency which ^rlngs 'together 

state staff from across the region to consider research-t elated topics, 

developing educational issues, and the effects of current state educational 

Improvement efforts.* 

Figure 4 summari'^.es Che kinds and amount of assistance RBS provided with 
respect to the eight cases. Th3 figure shows that. In most casas, RBS has 
provided multiple types of services. 

In terms of content, RBS has found that 13 domains of cutrent knowledge 
and practice are most relevant to present state educational improvement 
efforts. These domains fall into three clusters. The first cluster is made 
up of those domains which address classroom and school practices which direct- 
ly affect students. 

• Literature on effective teaching and effective classrooms — for exam- 
ple, the work of Kcunin, Brophy, Good, Stallings, Evertson, and 
Fisher, among others, who have identified characteristics of effective 
teaching and effective classrooms; and the development work of the 
Texas R&D Center, SWRL, RBS, and numerous NDN projects which have 
sought to desij^n educational practices consistent with that work. 

• Literature on stratesieo for adapting educational programs ana in- 
struction for children with special needs — for example, Bamberg's 
analysis of successful and unsuccessful remediation practices; 
Jennings , Roueche and Snow's, Fassler's, and Early's writings on the 
program requirements, training, planuing, cress-course integration. 



*The 1984 study reported that state staff wanted RBS to increase the number of 
meetings it sponsored for them. 
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Figure 6 

KINDS ANU AMOUNT OF ASSISTANCE PROVIDED BY RBS 



1. Eacouragt Schools Co iBplcacnt More Effective 
RAD-bsMd Tnscrucclonal ProcMsea (Nsr/land) 



2. IncrMM Schools* Utt of Coapuccrt m <o 
iDAicracdonal Rttourct (Dcl<tf«r«) 



3. laprova TMch«r Qutllty OMiryluid) 



4, Xmpraw ch« Quel icy of Lcc«I Tttchtr Supcr- 
vldon/Evtliuclon Sytcemt fPitnnsylvtnlt) 



5. Improvt Educn clonal 7ro|ra» for Dcllncjenc and 
Dltrupdva Touch (Cclatn^c) 



6. I«prova cht Qutlfcy of Educn^loo frovidad by 
Urban Schools (Ncv Jcraay) 



7, laprova cha Ef facdvanaaa of Local Chapc«r 1 
Prograa* (Huld-Scaca) 



6, Incraaaa Educacora' Atfaranaaa ^nd Undcracanding 
of Raaaarch falacad co Taachlng tha Baalc Skllla 
and Sdanct (Kaglonal) 
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testing, and record-keeping aspects of successful remedial progrtuns; 
the work of Wang and Reynolds on Individualized education for failing 
students; the work of Certo, Voltz» and Madden and Slavln on Inte- 
grated education for handicapped stud<jnts; the work of Ben-Zeev, 
Cummins, Modlnao, Valdes, and Vong-Flllmore on students with low 
English proficiency and on second language learning. 

• Literature related to specific content areas — for example, the 
research cited In Research Within Reach syntheses which the R&D 
Exchange have collaboratively developed regarding the teaching of 
reading (Weaver) , mathematics (Drlscol J ) , and oral and written 
comiLjnlcatlon (Holdzkom) • 

• Literature on educational technology — for example, software reviews 
from EPIE Pro^FILES, and MSDE's MIRN project; descriptions of specific 
applications from NDN and the National Science Foundation; meta- 
analyses related to the use and effects of microcomputers In Instruc- 
tion from B^ms and Bozman, and Kullk, Bangert and Wllllaias; longitu- 
dinal studies by ETS (Ragosta) and Merrimack Education Ce :^er« 

• Literature on effective schools—for example, the work of Brookover, 
Lezotte, Edmonds, Austin, and Rutter, among others, who have Investi- 
gated the characteristics of high and low performing schools and have 
built a c^'se that schools do make a difference. 

The second cluster is made up of those domains which are concerned with school 

policies, processes, and structures which can influence classroom and school 



• Literature on teacher evaluation/supervision — for example, the work of 
Darling-Hammond, Wise, and McGreal on successful teacher evaluation, 
and the related works of Sergiovanni, Sweeney and Manatt, Blckel and 
Artz, Goldsberry, and Bridges regarding principals' leadership, 
clinical supervision, teem approaches to supervision, and the real- 
ities of supervising the marginal teacher; Grimsley and Bruce; and 
Squires, Huitt, and Segars on how supervision relates to instructional 
improvement. 

• Literature on adult learning and effective in^^ervice — tor example, the 
work of Andrews, Orlich, Little, and Joyce which summarizes current 
practice, and the ways in which different inservice strategies result 
in different oitcomes. 

• Literature on school and district management — for example, the work of 
Cummings and Cook (an NDN management program) , and of Willower and 
Fraser, Ilannaway and Sproul, and Erickson which examines current 
prac' *ce in educational administration. 

• Literature on public/private partnerships in education — for example, 
McNett's Drofile of school/business collaboration, Schilit and Lacey's 
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resource guide and planning manual on exemplity types of schorl/ 
business partnerships, Jackson's booklet on how to form partne ships, 
and Chaffee's overview of partnership models* 

The third cluster Is made up of those domains dealing with strategies and 

techniques that external agents (Including state governments) can use to 

affecc district, school, and classroom practice. 

• Literature on organizational development and organlzitlonal change — 
for example, the work of Trlst, Handy, English, Ackoff , Aiken, and 
Hage which examines soclo-technlcal syste&s^ the uynamlcs cf relation- 
ships between the Individual, the organization, and external pres- 
sures, and the Interactions among the technoli glcal , cultural, and 
political dimensions of organizations. 

• Literature on technical assistance and on the role of exfemal/ 
internal "linkers" in facilitating knowledge use — for exuidple, the 
work of Moore, Seiber, Louis, Fullan^ and Cox which demonstrates the 
importance of the human agent in helping school and district staff use 
the results of educational R&D. 

• Literature on research and evaluation methodology c^nd practice — for 
example, the work of Fink and Kosicoff , and the state departments of 
California and Georgia which preser'-s practitioner-criented synthases; 
and the work of Miles, Yin, Cuba, and ?^hers which explores efi. active 
methodology combining qualitative an^ quantitative approaches. 

• Literature on federal education programs and their effects — for 
example, SRI*s study of the National Diffusion Network, Rand's study 
of four federal change agent programs, Abt*s study of the R&D Uti- 
lization Program, The NETWORK'S study of dissemination programr^, and 
NTS* study of St^te Dissemination Capacity Building Projects. 



RBS' Regional Exchange ag a Problem 

Though state leaders see RBS as a source of process help and content 
expertise, they also perceive the very cxistenco of the Exchange project as a 
judgment on their capablMty. For them, the ^.xistence of the project implies 
that states do not have the capacity to stay abreast of educational R&D, and 
that evra when they do, they do not utilize the results of educational R&D 
when they develop new educational policies, or design and implement educa- 
tional Improvement programs. Second, for them, the goa4.d of the project 
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appear to communicate the expectation that states have to have educational - 

Imr^rovement efforts* Third, those goals also appear to communicate the I 

expectation that state leaders should not only be open to a federally-funded J 

resource, but should be vlllln'; to commit time and energy to planning ways to \ 

use that resource productively. Thus, state lea*«rs can exhibit at times both I 
an approach and an avoidance disposition to a regional exchange* This 

disposition Is only somevhat moderated by state- axchange collaborative efforts I 

which are, in their terms, successful* J 

Perspectives on Outcomes and on the Conditions Affecting Them J 
Knott and Wlldavsky (1980; proposed seven standards for knowledge uti- 
lization: reception, cognition, reference, effort, adoption. Implementation, 
and Impact. RBS has usec^, these standards to posit three levels of outcomes 
for Its work vl states, and an analogous three levels of outcomes for 
states* work with school districts and s«,hools* First, RBS has tried to 
Increase state leaders* awareness and understanding of educational R&D which 
may have Implications for the design and Implementation tasks In which they 
are engaged* Second, assuming success In achieving the first outcome, tv3S has 
tried tc help state leaders modify or dev^ilop policies, guidelines, programs, 
and resource documents, so that they reflect currer :!1D i.indlngs« Finally, 
assuming some success with the second outcome, RBS has tried to help state 
leaders modify such state practices as the assistance they offer schools and 
districts, the staff development programs they conduct, and the way they 
monitor school and district performanwe. 

Analogously, states can seek, through their educational Improvement 
efforts, a similar set of outcomes. They can seek to Increase school and 
district staff awareness and understanding of what is known, for example, 

^ , . " H 



about effective teachings effective classrooms, and effective schools. They 
can encourage schools and districts to modify or develop policies and plans 
based on those understandings « And, finally, they can -ncourage schools and 
districts to modify current practices In ways vhlch reflect what Is known. 

Figure 5 summarizes for the eight cases the types of outcomes which each 
effort has achieved. The actual scope of these achievements were described In 
each case. 

The remilnder of this pari examines four sets of conditions which RBS 
believes most affect the kinds of outcomes acnleved and the scope of Impact 
of particular state educational Improvem^at efforts. First, there are such 
conditions as the following, which exist within states. 

• Extent to which state leaders make educational Improvement a priority 
of their administration ^! State leaders (governors, chiefs, SEA middle 
managers, legislative Ic iders) differ considerably on the emphasis 
they place on educational Improvement. RBS has been fortunate to work 
with four states which have a hlstorv of providing leadership for 
educational improvement which goes well beycad the recent spirit of 
reform. 

• Extent to which state leaders are able to create the management 
conditions for an effective improvement effort . St^te leaders have 
had varying success in both obtaining and focusing resources and staff 
needed to initiate significant Improvement efforts. Th«.y have also 
had varying success in maintaining efforts for a sufticient length of 
time to have an impact. The Abt study* 8 general concrision was that 
states rarely succeed in creating these conditions, and thus end up 
conducting essentially "symbolic** activities. RBS* stages have ex- 
perienced these difficulties; howevar* in contrast to Abt*8 find^.ngs, 
each have managed to undertake one or more educational improvement 
efforts which have had notable Impact. 

• Extent to which there Is stable state le. .dership . A condition which 
is closely related to the one Just described is the stability of state 
leadership. As noted earlier in tMs section, RBS works with two 
states which hav^ had stable leadership and two which have not. It is 
RBS' experience that a state *8 ability to initiate and sustain multi- 
year improvement efforts is affected by the stability of its leaders. 

^ Extent to which state educational Impi ivemcnt efforts establish clear 
and defensible standards or expectations for local educators . It is 
the nature of the political process to favor standards or expectations 
which either reflect current practice or are sufficiently ambiguous 
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Figure 5 
TYPES OF OUTCOMES 



1» GDcouragc Srnoolt to laploi^nt Mors Efftcclvc 
KlD-bMad Ina truce ional ProLMtca (Haryl^nd) 



2. IncrMM Schools' of Coaputcrt m an 
Instniccional. ItCMurca (Delavara) 



3. laprova TMchcr Quallcy (Harylnd) 



4» laprcva cha Quality of Local Tcachar Supar- 
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7. laprova tha Ef factivanaaa of l.oca? Chaptar 1 
FrogriM (Mulci-Stata) 
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to allow considerable local discretion. RBS* states have, In several 
instances 9 developed standards and expectations which have been rela* 
tlvely precise and which. In addition, have been defensible on empiri- 
cal grounds. Those Improvement efforts which have produced such stan- 
dards and expectations seem to have had significant Impact on local 
practice. 

• Extent to which state educational Improvement efforts use multiple 
strategies for encouraging local action to meet expectations . Over 
the past ten years, there has been considerable growth In the knowl- 
edge of educational change and how external agents, like state govern- 
ments, can support It. Each of RBS' states has used each of the 
primary strategies for affecting local action; each has also mounted 
efforts whose scope end diversity of methods were sufficient to affect 
significant change. Yet, from a regional perspective, the latter are 
difficult for moFt states to mount. 

• Extent to which states design their educational Improvement efforts as 
collaboratlves . There are two general approaches state leaders take 
to designing their educational Improvement efforts. One Is a top- 
down, regulatory-focused approach which emphasizes the authority and 
bureaucratic standards of the educational system. The other Is a more 
collaborative approach through which states try to develop a shared 
commitment to a common goal and to provide the leadership, assistance, 
and Incentives which ensure ^he contributions of all members of the 
educational community. Any given Improvement effort can Incorporate 
both approaches. It Is RBS* perspective, however, that state educa- 
tional Improvement efforts which Incorporate the collaborative ap- 
proach are generally store Luccessful nt harnessing local commitment 
and resources. For reasons of structure, tradition, or leadership 
disposition, some of RBS* states find it easier to Inrlude a collab- 
orative approach in their Improvement efforts. 

• Extent to which states are open to outside resources . Closely related 
to its disposition to use a collaborative approach is a state's 
disposition to use outside resources. State leaders vary in the 
extent to which they use outside resources and seek knowledge, as they 
design and implement educational Improvement efforts. From RBS' per- 
spective, this disposition, and the incentives which sustain it, 
affect how state leaders use a resource like RBS. 

The second set of conditions affecting Impact is related to the status of 

the R&D knowledge base. For some of the educational improvement efforts vhlch 

states are undertaking, there is a considerable knowledge base (e.g., basic 

skills improvement. Instructional Improvement); for other efforts, there is 

little accumulaf knowledge (e.g., policies and programs which will increase 
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the quantity of qualified teachers in the 19908). The extent to v^ich *:here 
is a knowledge base that speaks to a given state educational improvement 
effort can significantly influence the extent to which RBS can contribute to 
that effort. 

Third, there are conditions w^ithin the laboratory which affect the 
character of the relationship. These conditions are primarily related to 
the extent to which appropriate staff, in terms of knowledge anc' skill, can 
be assigned at the time and at a level of effort which will be responsive to 
state interests and needs. As suggested by RBS* organization of the Exchange 
project, it has used a strategy of having a stable team work with each state, 
and to supplement each tean with staff from other projects. The current 
arrangement facilitates ongoing needs sensing and negotiations regarding 
services to given states. It also has the potential of giving state leaders 
access to the full range of RBS' staff and other resources, though in reality 
the schedule of >rk of other projects determines which staff can be assigned 
to state tasks. 

Fourth, there are conditions external to the relationship. The cases 
illustrate three external influences: agendas established by national leaders 
(e.g., the National Commission on Excellence in Education, Secretary Bell's 
Chapter 1 initiative), incentives aimed at stimulating state an^ local action 
(e.g., discretionary funds for cooperative Chapter 1 ptogram improvement 
projects), and resources (e.g., Research Within Reach publications). It has 
been RBS' experierce that such external conditions can activate state and 
local energies, provide a focus for those energies, and stimulate improvement 
efforirs whose scope, intensity, and duration result in an impact on local 
practice. 
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RECOMMENDATIONS FOR THE FUTUP^ 

This report has described eight of the 31 major state and regional 
educational improvement activities on which RBS has worked over the past three 
yei./s. It has also described RBS' view of states and their role la educa- 
tional improvement, and RBS' views of itself and the services it provides in 
support of state educational improvement activities. Finally, it has 
described some of the conditions affecting the impact of state and RBS 
activities. Given NIE's id RBS' plans to continue providing research and 
development-based assistance to state leaders, this section considers the 
implications of RBS' experiences and perspectives for the future assistance 
effort. This discussion is organized into two parts: implications for 
federal leaders and implications for laboratory leaders. 

Implication* for Federal Leaders 
Like state governments, the federal government sets expectations for 
education-related agencies and undertakes a variety of activities to encourage 
them to meet those expectations. The federal government has set forth its 
expectations for regional exchanges in its Requests For Proposals, which have 
specified the clients, listed appropriate activities, and stated the desired 
outcomes. The federal government has encouraged regional exchanges to meet 
those expectations primarily through monitoring activities and r lated 
reporting requirements. 

Two of the case studies provide specific examples of other ways in which 
the federal government has provided leadership. In the Chapter 1 program 
improvement case, the U.S. Secretary of Education made program Improvement a 
priority, provided incentive grants from his discretionary funds, and 
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encouraged collaborative projects Involvlu^j state and local Chapter 1 staff 
and technical assistance projects like the regional exchanges* Though the 
Secretary's grants were only for one year, they provided a sufficient incentive 
for six states i two regional exchanges, and the Chapter 1 technical assistance 
center to undertake the collaborative development of a process which is being 
adopted and implemented by several of the participating states. 

By funding the Research and Development Interpretation Service (RDIS) 
and by informally encouraging RDIS to involve the regional exchanges in the 
development of the Research Within Reach publications, che federal government 
encouraged a cooperative effort which has brought to the attention of educators 
throughout the nation current research re^^arding the teaching of reading, oral 
and written communication skills, mathematics, and science. 

These experiences suggest two recommendations for federal leadership. 

1, Use a greater variety of strategies to encourage laboratories to meet the 
expectations which have been established for their state leadership assistance 
projects . 

This report has described the variety of strategies states are using to 
encourage local districts, schools, and staff to fulfill the expectations set 
forth in law, regulations, and state leadership's priorities. To date, the 
federal government has primarily vzed a monitoring approach to encourage 
laboratory staffs to attend to its expectations. Sta^e example suggests that 
the federal government cculd do more. For example, it could foster sharing 
and discussion of successful p^^ojects, it could support follow-up training 
and technical assistance to help one project replicate another project's 
successes, and it could provide fiscal incenti^'es for such exchange. Through 
such activities, the federal government would add a .norc proactive and 
positive approach to helping laboratories achieve feaeral intents I'or state 
assistance activities. 
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2, Provide leadership and Incsntlve funds for multi-state collaborative 
Improvenent projects . 

The Chapter 1 and RDIS cases Illustrate other ways In which federal 
leadership can be exercised* In the first, the federal government Identified 
a need and provided some Incentive dollars for collaborative projects which 
addressed that need* In the second, the federal government, by funding RDIS 
supported collaborative dlcoeiulnatlon nationwide of selected research find- 
ings* In both cases, federal leadership plus modest grants stimulated 
significant collaborative activity which was funded primarily by state, local, 
and laboratory resources* 

Implications for Laboratory Leaders 

Ihe case studies and related discussion In this report suggest how stages 
can affect educational Improvement and how laboratories can support those 
state activities They also suggest the outcomes state educational Improvement 
activities can achieve and some of the conditions ^h'ch can affect the nature 
and scope of the outcomes* Thus, this report provides laboratory leaders with 
examples of what Is possible* 

Given this perspective, two recommendations for laborar.ory leaders can 
be framerd* 

1 * Use tlie knowledge and perspectives gained from these case studies In 
negotiations wl^n state leaders * 

The report presents a number of conceptual frameworks for viewing state 

educational improvement activities* There is a framework of state inter* 

actions (see iigure 3, page 16), the list of activities states can undertake 

to help local educators meet new expectation's (see page 64), the statement 

of outcomes from a knowledge utilization perspective (see figure 5, page 80), 

and the list of conditions which can influence the outcomes that can be 



ERLC 



85 9^ 



achieved and the scope of their impact (see pages 79-81). All of these can 
be used by laboratory leaders as they negotiate with state leaders how the 
laboratory can best support their educational improvement priorities. They 
can be used to clarify a state leader's intentions. They can be be used to 
clarify the nature and scope of the outcomes that are desired. They can be 
used to suggest general strategies and specific activities which the state 
could undertake. They can be used to suggest management conditions which 
state leaders Med to create to ensure a productive effort. And, finally, 
they can be used as criteria against which the potential of different state 
educational improvement activities can be assessed. RBS has found that its 
use of these frameworks has affected its negotiations with sta^e lecders in 
three ways. First, it has become increasingly selective regarding the state 
priorities It agrees to support. Second, It has encouraged a reduction in 
assistance activities when the potential impact of a state priority is 
reduced. Third, it has led to more differential assignments of its resources 
by both priority and state. RBS believes these outcomes are positive ones ^.nd 
should be encouraged. 

2. Continue to support documentation and assessment activities which expand 
understanding of how states can best affect the quality of local educational 
practice, and how laboratories can best assist them * 

This report reflects understandings which RBS has developed as a result 

of its documentation activities and of studies it has conducted at the request 

of state education agencies (e.g., studies related to Maryland's School 

Improvement Through Instructional Process program) , the two studies it 

sponsored of Its own activities, and ita participation in the Abt Associates' 

study of NIE*8 general purpose dissemination assistance projects. It is clear 

from this work that researchers, educational leaders, and policy makers are 
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only beginning to understand how states can best affect the quality of local 
educational practice. It Is also clear that they are only beginning to 
understand how laboratories can best assist state leaders. 

Therefore ; it is recommended that laboratories continue to Improve how 
they document their assistance to state leaders » and that they continue to 
sponsor third-party assessments of their services to state leaders. It is 
also recommended that laboratories continue to encourage ana support state 
efforts to document and evaluate their educational improvement activities. 
Finally, it is recommended that laboratories, given their regional perspec- 
tive, consider conducting studies which examine from local perspectives the 
comparative advantage of alternative state educational improvement activities. 
The knowledge and understanding gained from these activities — particularly, if 
':onducted by laboratories across the country — should help state and laboratory 
leaders design and conduct more effective educational improvement activities. 



*lt is RBS' perspective, that current understanding of how states can best 
affect local education practice is only influencing the design of a small 
number of their current educational improvement activities. 
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1. 



LIST OF MAJOR PRODUCTS RELATED TO THE EIGHT CASES 

Encourage Schools to Implement More Effective R&D-based Instructional 
Processes (Maryland) 

Conference Reports: 

• Instructional Leadership Conference: Evaluation, Spring 1982 

• Instructional Improvement: Conference Proceedings, October 1982 

• Instructional Leadership Conference: Local Education Agency, May 4, 
1983 

• Instructional Leadership Conference: Maryland State Department of 
Education, May 5, 1983 

• School Improvement Through Instructional Process (SITIP) Summer 
Institute, July 1983 

• Instructional Leadership Conference: SITIP, May 1984 

• Supervision: Conference Proceedings, October 1984 

Evaluation Reports: 

• Instructional Improvement in Maryland: A Study of Research in 
Practice. Executive Summary, October 1982 

• Instructional Improvement in Maryland: A Study of Research in 
Practice, October 1982 

• Instructional Improvement in Maryland: Impact on Educators and 
Students. Executive Summary, January 1984 

• Instructional Improvement in Maryland: Impact on Educators ;ind 
Students, January 1984 

• SITIP Case Studies, October 1984 

• Maintainirg Instructional Improvement: SITIP 1984-1985, September 
1985 



Training Material: 

• Instructional Improvement: A System-wide Approach, Marrh 1982 
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Presentations: 



• Planning: Its Evolution through Knowledge Utilization. AERA, April 
1983 

• Instructional Improvement: Roles and Responsibilities in Statewide 
Change. AERA, April 1983 

• Impact of Instructional Improvement: A Statewide Program. AERA* 
April 1984 

• Teachers as Instructional Leaders. AERA, April 1984 (bummary and 
paper) 

• Aligning Staff Development with Implementation Strategies. AERA, 
April 1985 (summary and paper) 



2. Increase Schools' Use of Computers as an InLtmctional Resource (Delaware) 

• State Plan for the Use of Computers in Education (K-12) for Delax^are 
School Districts, June 1984 

• Using Microcomputers for Instruction of Mathematics, Social Studies, 
Language Arts: Red Clay Consolidated School District Microcomputer 
Inservice Program, June 1984 

• Using Computers for Instruction: Some Considerations, October 1984 



3. Improve Teacher Quality (Maryland) 

• Rewarding Teachers: Issues and Incentives, July 1983 

• The Well-Managed Classroom. A Presentation Outline, April 1984 

• Maryland Criteria for Beginning Teachers. Research References, August 
1985 

• Maryland Criteria for Beginning Teachers. Content Validity Survey, 
October 1985 



4. Improve the Quality of Local Teacher Supervision/Evaluation Systems 
(Pennsylvania) 

• Summary of Discussion and Recommendations of Science and Mathematics 
Supervision Groups. Pennsylvania Department of Education Science and 
Mathematics Leadership Seminar, April 1984 

• Presenter's Resource Book. Pennsylvania Department of Education's 
Supervision/Evaluation Academy, September 1984 
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^ A Description and Critical Analysis of Effective Teacher Supervision/ 
Evaluation Systems, October 1985 



5. Improve Educational Programs for Delinquent and Disruptive Youth 
(Delaware) 

• A Report of Educational Improvements at Delaware State Youth 
Corrections Facilities, November 1983 

• Competencies Assessment Test: Reading, Writing, and Mathematics, 
August 1984 

• Improving Delaware Youth Rehabilitative Services* Final Report, 
November 1985 



6. Improving the Quality of Education Provided by Urban Schools (New Jersey) 

• Implementing the "Effective Schools" Research. Pre-Seminar Reader, 
May 1983 

• Planning for the Implementation of Operation School Renewal, August 
1984 

• The Urban Initiative Sourcebook* A Discussion of the Literature and A 
Directory of Exemplary Practices and Programs, August 1985 



7. Improve the Effectiveness of Local Chapter 1 Programs (Multi-State) 

• Chapter 1 Program Improvement Guide, October 1984 

• Chapter 1 Program Improvement Instruments and Report Form, October 
1984 

• Chapter 1 Program Improvement Resourcebook for Team Trainers, October 
1984 



8. Increase Educator's Awareness and Understanding of Research Related to 
Teaching the Basic Skills and Science (Regional) 

• Improving Writing Skills. Portfolio for New Jersey Department of 
Education Workshop, January 1984 

• Research Within Reach: Science and Mathematics. Portfolio for 
Turnkey Training Workshop, March 1985 

• Research Within Reach: Oral and Written Communication and Reading* 
Portfolio for Turnkey Training Workshop, April 1985 

• Science Education rkshop. Shippensburg Curriculum Conference, July 
1985 
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